googletesting

GTAC 2014 Wrap-up

Thursday, December 4, 2014

by Anthony Vallone on behalf of the GTAC Committee GTAC 2014Google Kirkland officeArgentina, Australia, Canada, China, many European countries, India, Israel, Korea, New Zealand, Puerto Rico, Russia, Taiwan, and many US states

Adobe, American Express, Comcast, Dropbox, Facebook, FINRA, Google, HP, Medidata Solutions, Mozilla, Netflix, Orange, and University of Waterlooslides and video recordings

TwitterGoogle+

speakersGoogle Testing Blog

Protractor: Angular testing made easy

Sunday, November 30, 2014

By Hank Duan, Julie Ralph, and Arif Sukoco in Seattle protractortest.org

You don’t need to add waits or sleeps to your test. Protractor can communicate with your AngularJS app automatically and execute the next step in your test the moment the webpage finishes pending tasks, so you don’t have to worry about waiting for your test and webpage to sync.

It supports Angular-specific locator strategies (e.g., binding, model, repeater) as well as native WebDriver locator strategies (e.g., ID, CSS selector, XPath). This allows you to test Angular-specific elements without any setup effort on your part.

It is easy to set up page objects. Protractor does not execute WebDriver commands until an action is needed (e.g., get, sendKeys, click). This way you can set up page objects so tests can manipulate page elements without touching the HTML.

It uses Jasmine, the framework you use to write AngularJS unit tests, and Javascript, the same language you use to write AngularJS apps.

1) Set up environment npm install -g protractorwebdriver-manager update & webdriver-manager starthttp://localhost:44442) Write your test// It is a good idea to use page objects to modularize your testing logic
var angularHomepage = {
nameInput : element(by.model('yourName')),
greeting : element(by.binding('yourName')),
get : function() {
browser.get('index.html');
},
setName : function(name) {
this.nameInput.sendKeys(name);
}
};

// Here we are using the Jasmine test framework
// See http://jasmine.github.io/2.0/introduction.html for more details
describe('angularjs homepage', function() {
it('should greet the named user', function(){
angularHomepage.get();
angularHomepage.setName('Julie');
expect(angularHomepage.greeting.getText()).
toEqual('Hello Julie!');
});
});exports.config = {
seleniumAddress: 'http://localhost:4444/wd/hub',

specs: ['testFolder/*'],

multiCapabilities: [{
'browserName': 'chrome',
// browser-specific tests
specs: 'chromeTests/*'
}, {
'browserName': 'firefox',
// run tests in parallel
shardTestFiles: true
}],

baseUrl: 'http://www.angularjs.org',
};protractor conf.js1 test, 1 assertions, 0 failureshttp://angular.github.io/protractor/#/tutorial

GTAC 2014 is this Week!

Monday, October 27, 2014

by Anthony Vallone on behalf of the GTAC Committee speaker profileslive stream pageupdated parking information

Testing on the Toilet: Writing Descriptive Test Names

Thursday, October 16, 2014

by Andrew Trenk This article was adapted from a Google Testing on the Toilet (TotT) episode. You can download a printer-friendly version of this TotT episode and post it in your office. How long does it take you to figure out what behavior is being tested in the following code? @Test public void isUserLockedOut_invalidLogin() {
authenticator.authenticate(username, invalidPassword);
assertFalse(authenticator.isUserLockedOut(username));

authenticator.authenticate(username, invalidPassword);
assertFalse(authenticator.isUserLockedOut(username));

authenticator.authenticate(username, invalidPassword);
assertTrue(authenticator.isUserLockedOut(username));
}You probably had to read through every line of codehow long would it take you to figure out what behavior is being tested if the test had this name?isUserLockedOut_lockOutUserAfterThreeInvalidLoginAttempts
You should now be able to understand what behavior is being tested by reading just the test namePutting both the scenario and the expected outcome in the test name has several other benefits: If you want to know all the possible behaviors a class has, all you need to do is read through the test names in its test classBy giving tests more explicit names, it forces you to split up testing different behaviors into separate testsThe exact behavior being tested might not always be clear from the test codeYou can easily tell if some functionality isn’t being testedWhen a test fails, you can immediately see what functionality is broken without looking at the test’s source codeshouldLockOutUserAfterThreeInvalidLoginAttemptsMake sure test names contain both the scenario being tested and the expected outcome

Announcing the GTAC 2014 Agenda

Tuesday, September 30, 2014

by Anthony Vallone on behalf of the GTAC Committee developers.google.com/gtac/2014/scheduleYouTube live streaming

Chrome - Firefox WebRTC Interop Test - Pt 2

Tuesday, September 9, 2014

by Patrik Höglund
This is the second in a series of articles about Chrome’s WebRTC Interop Test. See the first.Verifying the Callapprtc.appspot.comremoteVideo.style.opacitybool WaitForCallToComeUp(content::WebContents* tab_contents) {
// Apprtc will set remoteVideo.style.opacity to 1 when the call comes up.
std::string javascript =
"window.domAutomationController.send(remoteVideo.style.opacity)";
return test::PollingWaitUntil(javascript, "1", tab_contents);
}
Verifying Video is Playingexisting video detectorbool DetectRemoteVideoPlaying(content::WebContents* tab_contents) {
if (!EvalInJavascriptFile(tab_contents, GetSourceDir().Append(
FILE_PATH_LITERAL(
"chrome/test/data/webrtc/test_functions.js"))))
return false;
if (!EvalInJavascriptFile(tab_contents, GetSourceDir().Append(
FILE_PATH_LITERAL(
"chrome/test/data/webrtc/video_detector.js"))))
return false;

// The remote video tag is called remoteVideo in the AppRTC code.
StartDetectingVideo(tab_contents, "remoteVideo");
WaitForVideoToPlay(tab_contents);
return true;
}StartDetectingVideoWaitForVideoToPlayvideo_detector.jsWhat to Send in the Call--use-fake-device-for-media-streamregular test infrastructureWebRTC waterfallsif (!HasWebcamOnSystem())
return;
Downloading all Code and Components

The AppEngine SDK in order to bring up the local AppRTC instance,

The AppRTC code itself,

Chrome (already present in the checkout), and

Firefox nightly.

thousands and thousands of machinesDownloading the AppEngine SDKauthoritative sourceGoogle storagedepot_toolsdownload_from_google_storage.pyDownloading the AppRTC CodeChromium DEPS fileDownloading Firefoxin this scriptfails every now and thenPutting it Togetherfinal code here.gclient solution

Also run on Windows/Mac.

Also test Opera.

Interop between Chrome/Firefox mobile and desktop browsers.

Also ensure audio is playing.

Measure bandwidth stats, video quality, etc.

Chrome - Firefox WebRTC Interop Test - Pt 1

Tuesday, August 26, 2014

by Patrik Höglund WebRTCworking video chatsmall amount of Python and JavaScriptCalling in WebRTC

Figure 1. Signaling and media connections.AppRTC reference applicationTest Designpeerconnection_serverapprtc.appspot.comvideo+canvas grab trickWebRTC getStats

Figure 2. Basic test design.hermeticBringing up AppRTC on localhostGoogle App Engine applicationhello world examplegoogle_appengine/dev_appserver.py apprtc_code/bool LaunchApprtcInstanceOnLocalhost()
// ... Figure out locations of SDK and apprtc code ...
CommandLine command_line(CommandLine::NO_PROGRAM);
EXPECT_TRUE(GetPythonCommand(&command_line));

command_line.AppendArgPath(appengine_dev_appserver);
command_line.AppendArgPath(apprtc_dir);
command_line.AppendArg("--port=9999");
command_line.AppendArg("--admin_port=9998");
command_line.AppendArg("--skip_sdk_update_check");

VLOG(1) << "Running " << command_line.GetCommandLineString();
return base::LaunchProcess(command_line, base::LaunchOptions(),
&dev_appserver_);
}
^[1]Figuring out Whether the Local Server is Up http://localhost:9999?r=some_roomdev_appserver.pybool LocalApprtcInstanceIsUp() {
// Load the admin page and see if we manage to load it right.
ui_test_utils::NavigateToURL(browser(), GURL("localhost:9998"));
content::WebContents* tab_contents =
browser()->tab_strip_model()->GetActiveWebContents();
std::string javascript =
"window.domAutomationController.send(document.title)";
std::string result;
if (!content::ExecuteScriptAndExtractString(tab_contents,
javascript,
&result))
return false;

return result == kTitlePageOfAppEngineAdminPage;
}
9998localhost:9999while (!LocalApprtcInstanceIsUp())
VLOG(1) << "Waiting for AppRTC to come up...";
Launching the Browsers launcher python scriptfrom mozprofile import profile
from mozrunner import runner

WEBRTC_PREFERENCES = {
'media.navigator.permission.disabled': True,
}

def main():
# Set up flags, handle SIGTERM, etc
# ...
firefox_profile =
profile.FirefoxProfile(preferences=WEBRTC_PREFERENCES)
firefox_runner = runner.FirefoxRunner(
profile=firefox_profile, binary=options.binary,
cmdargs=[options.webpage])

firefox_runner.start()GURL room_url =
GURL(base::StringPrintf("http://localhost:9999?r=room_%d",
base::RandInt(0, 65536)));
content::WebContents* chrome_tab =
OpenPageAndAcceptUserMedia(room_url);
ASSERT_TRUE(LaunchFirefoxWithUrl(room_url));run_firefox_webrtc.py --binary /path/to/firefox --webpage http://localhost::9999?r=my_room1

Testing Blog

GTAC 2014 Wrap-up

Protractor: Angular testing made easy

GTAC 2014 is this Week!

Testing on the Toilet: Writing Descriptive Test Names

Announcing the GTAC 2014 Agenda

Chrome - Firefox WebRTC Interop Test - Pt 2

Chrome - Firefox WebRTC Interop Test - Pt 1

Labels

Archive

Feed

Company-wide

Products

Developers