-
Notifications
You must be signed in to change notification settings - Fork 16
/
index.html
127 lines (98 loc) · 6.37 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
<html>
<head>
<meta charset="utf-8"/>
<meta name="generator" content="http://dreamwriter.io"/>
<style type="text/css">
@page {
margin: 0.8cm;
}
::selection {
background: #e0e0e0;
color: inherit;
text-shadow: inherit;
}
::-moz-selection {
background: #e0e0e0;
color: inherit;
text-shadow: inherit;
}
body {
font-size: 12px;
color: black;
font-family: Georgia, PT Serif, Times New Roman, serif;
overflow-x: visible;
width: 42em;
padding: 6em 1.5em 6em 1.5em;
margin-left: auto;
margin-right: auto;
word-wrap: break-word;
}
h1, h2, h3, h4 {
font-weight: normal;
font-family: inherit;
text-align: center;
margin: 0;
line-height: 1.1em;
}
h1 {
margin-bottom: 24px;
font-size: 48px;
}
h2 {
font-size: 36px;
margin-top: 36px;
margin-bottom: 36px;
page-break-before: always;
}
h3 {
font-size: 24px;
margin-bottom: 96px;
line-height: 1.5em;
}
p, div {
font-family: inherit;
text-indent: 30px;
margin: 0;
line-height: 1.5em;
font-size: 18px;
}
p > *, div > * {
text-indent: 0;
}
hr {
width: 20%;
margin-top: 24px;
margin-bottom: 24px;
margin-left: auto;
margin-right: auto;
background-color: black;
}
blockquote {
margin-left: 1em;
page-break-inside: avoid;
}
</style>
</head>
<body><h1 id="edit-title" contenteditable="false" class="Medium Medium-inline" spellcheck="false">Online Experiments for Computational Social Science</h1>
<h3>Eytan Bakshy & Sean J. Taylor <br>
2015 International World Wide Web Conference (WWW)</h3>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false">Abstract</h2>
<div id="edit-description" contenteditable="false" class="Medium Medium-inline" spellcheck="false">
This tutorial teaches attendees how to design, plan, implement, and analyze online experiments. First, we review basic concepts in causal inference and motivate the need for experiments. Then we will discuss basic statistical tools to help plan experiments: exploratory analysis, power calculations, and the use of simulation in R. We then discuss statistical methods to estimate causal quantities of interest and construct appropriate confidence intervals. Particular attention will be given to scalable methods suitable for “big data”, including working with weighted data and clustered bootstrapping. We then discuss how to design and implement online experiments using PlanOut, an open-source toolkit for advanced online experimentation used at Facebook. We will show how basic “A/B tests”, within-subjects designs, as well as more sophisticated experiments can be implemented. We demonstrate how experimental designs from social computing literature can be implemented, and also review in detail two very large field experiments conducted at Facebook using PlanOut. Finally, we will discuss issues with logging and common errors in the deployment and analysis of experiments. Attendees will be given code examples and participate in the planning, implementation, and analysis of a Web application using Python, PlanOut, and R.
</div>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false">Slides</h2>
<iframe src="https://www.slideshare.net/slideshow/embed_code/key/hyAosOIMd7SHjt" width="476" height="400" frameborder="0" marginwidth="0" marginheight="0" scrolling="no"></iframe>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false">Notebooks</h2>
<div id="edit-chapter-body-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-body Medium Medium-rich" contenteditable="false" spellcheck="false"></div>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false"><a href="slides/0-estimation-and-power.slides.html">0. Estimation and Power</a></h2>
<div id="edit-chapter-body-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-body Medium Medium-rich" contenteditable="false" spellcheck="false"></div>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false"><a href="slides/1-planout-intro.slides.html">1. Introduction to PlanOut</a></h2>
<div id="edit-chapter-body-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-body Medium Medium-rich" contenteditable="false" spellcheck="false"></div>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false"><a href="slides/2-making-your-own-data.slides.html">2. Making Your Own Data</a></h2>
<div id="edit-chapter-body-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-body Medium Medium-rich" contenteditable="false" spellcheck="false"></div>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false"><a href="slides/4-analyzing-experiments.slides.html">3. Analyzing Experiments</a></h2>
<div id="edit-chapter-body-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-body Medium Medium-rich" contenteditable="false" spellcheck="false"></div>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false">Code</h2>
<h2 id="edit-chapter-heading-d0537b4fcd7fc266db9e1b7ceedac9dbdc9ba98f" class="chapter-heading Medium Medium-inline" contenteditable="false" spellcheck="false"><a href="http://github.com/eytan/www-15-tutorial">Github Repository</a></h2>
</body>
</html>