Maniphest T379241

Set up quicksurveys for non-UI experiment pt 2
Closed, ResolvedPublic1 Estimated Story Points
Actions

Description

NOTE: this re-uses the previous non-UI experiment survey

Background

We would like to recruit participants to our UI and non-UI experiments using quicksurveys
We will run 2 surveys that will recruit participants for each of the experiments

User story

As a reader, I would like to be told when there's opportunity to do user testing for new features, so that I can help out Wikipedia

Requirements non-UI survey

Quicksurvey setup

The survey will display a single question
Survey will link to a Google form with the remainder of the questions
Quicksurvey will display for 5% of logged-out users on English Wikipedia
Quicksurvey will contain the following copy: https://docs.google.com/spreadsheets/d/1SgYzlElvZ4ohvRtxPG1EuiQPsiZBEcqifk8aaJ8IBLI/edit?gid=1621294468#gid=1621294468 (tab: non-UI survey)
The copy includes a link to the privacy policy for the survey, provided directly in the table
Enable TBD

Design

Add mockups and design requirements

Communication criteria - does this need an announcement or discussion?

Add communication criteria

Sequencing

Justin to provide new survey URL
Jon to update https://en.wikipedia.org/wiki/MediaWiki:Ext-quicksurveys-non-ui-experiment-link with new survey link
Bernard to backport https://gerrit.wikimedia.org/r/c/1091749

Rollback plan

What is the rollback plan in production for this task if something goes wrong?

This task was created by Version 1.2.0 of the Web team task template using phabulous

Details

	Subject	Repo	Branch	Lines +/-
	Disable QuickSurveys for recommendations	operations/mediawiki-config	master	+2 -2
	Reenable non-UI experiment quick survey	operations/mediawiki-config	master	+1 -1

Customize query in gerrit

Related Objects
Search...

Status	Subtype	Assigned	Task
Open	Design	None	T370209 [EPIC] Experiment: Display article recommendations in more prominent locations
Open	Spike	None	T370523 [EPIC] Run UI-less experiment comparing API recommendation quality
Open		ovasileva	T374669 {GOAL] Run the non-ui survey with new recommendations
Resolved		ovasileva	T379241 Set up quicksurveys for non-UI experiment pt 2

Event Timeline

ovasileva triaged this task as High priority.Nov 7 2024, 12:34 PM

ovasileva created this task.

Jdrewniak set the point value for this task to 2.Nov 7 2024, 6:36 PM

Jdlrobson moved this task from Needs analysis to Ready for Development on the Web-Team-Backlog (FY2024-25 Q2 Sprint 4) board.Nov 7 2024, 6:36 PM

NBaca-WMF added a project: Web-Team.Nov 13 2024, 6:40 AM

NBaca-WMF moved this task from Product Backlog to Sprint Backlog on the Web-Team board.

NBaca-WMF moved this task from Sprint Backlog to Product Backlog on the Web-Team board.Nov 13 2024, 7:11 AM

NBaca-WMF moved this task from Product Backlog to FY2024-25 Q2 Sprint 4 (Nov 13 - Nov 26, 2024) on the Web-Team board.Nov 13 2024, 6:28 PM

NBaca-WMF edited projects, added Web-Team (FY2024-25 Q2 Sprint 4 (Nov 13 - Nov 26, 2024)); removed Web-Team.

bwang claimed this task.Nov 13 2024, 7:02 PM

bwang moved this task from Ready for Development to In Progress on the Web-Team (FY2024-25 Q2 Sprint 4 (Nov 13 - Nov 26, 2024)) board.Nov 13 2024, 11:16 PM

NBaca-WMF updated Other Assignee, added: Jdlrobson.Nov 14 2024, 5:10 PM

@JScherer-WMF HI can you confirm the google forms link in the spreadsheet is updated?

In T379241#10332873, @bwang wrote:

@JScherer-WMF HI can you confirm the google forms link in the spreadsheet is updated?

I'm not sure. I haven't had a chance to sync on this with @ovasileva since I've been back and she's OOO this week.

Change #1091749 had a related patch set uploaded (by Bernard Wang; author: Bernard Wang):

[operations/mediawiki-config@master] Reenable non-UI experiment quick survey

https://gerrit.wikimedia.org/r/1091749

gerritbot added a project: Patch-For-Review.Nov 19 2024, 8:20 PM

bwang removed bwang as the assignee of this task.Nov 19 2024, 8:20 PM

bwang subscribed.

Likely blocked on T379240 - let's check in standup.

NBaca-WMF assigned this task to JScherer-WMF.Nov 21 2024, 5:11 PM

NBaca-WMF updated Other Assignee, removed: Jdlrobson.

NBaca-WMF mentioned this in T374669: {GOAL] Run the non-ui survey with new recommendations.Nov 21 2024, 5:13 PM

The survey link here: https://en.wikipedia.org/wiki/MediaWiki:Ext-quicksurveys-non-ui-experiment-link and https://es.wikipedia.org/wiki/MediaWiki:Ext-quicksurveys-non-ui-experiment-link would need to be updated once we have the new survey ready before deploying https://gerrit.wikimedia.org/r/c/1091749.

Tomorrow morning: @ovasileva to update spreadsheet, send to @jscherer who will create the form - @Jdlrobson will update the link in the survey. We will aim to have everything ready to go by Friday Nov 29, deploy on Monday Dec 2. We'll use this ticket for deployments.

ovasileva updated the task description. (Show Details)Nov 27 2024, 5:07 PM

Jdlrobson updated the task description. (Show Details)Nov 27 2024, 5:08 PM

Jdrewniak changed the point value for this task from 2 to 1.Nov 28 2024, 6:26 PM

Jdrewniak edited projects, added Web-Team; removed Web-Team (FY2024-25 Q2 Sprint 4 (Nov 13 - Nov 26, 2024)).

Jdrewniak moved this task from Product Backlog to Sprint Backlog on the Web-Team board.

Link to completed survey

ovasileva mentioned this in T379240: Generate API list for recommended content.Dec 2 2024, 10:18 AM

SToyofuku-WMF changed the task status from Stalled to Open.Dec 2 2024, 7:00 PM

SToyofuku-WMF reassigned this task from JScherer-WMF to Jdlrobson.

Jdlrobson updated the task description. (Show Details)Dec 2 2024, 7:01 PM

SToyofuku-WMF moved this task from Sprint Backlog to FY2024-25 Q2 Sprint 5 (Dec 2 - Dec 13, 2024) on the Web-Team board.Dec 2 2024, 7:01 PM

SToyofuku-WMF edited projects, added Web-Team ( FY2024-25 Q2 Sprint 5 (Dec 2 - Dec 13, 2024)); removed Web-Team.

Jdlrobson moved this task from Ready for Development to In Progress on the Web-Team ( FY2024-25 Q2 Sprint 5 (Dec 2 - Dec 13, 2024)) board.Dec 2 2024, 7:33 PM

@bwang the wiki message is updated now for English.

Passing to you so we can get the config change ready (by removing Spanish): https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1091749

Jdlrobson updated the task description. (Show Details)Dec 2 2024, 9:17 PM

JScherer-WMF mentioned this in T381337: [DESIGN] Iterate on sidebar recommendations designs.Dec 2 2024, 10:30 PM

SToyofuku-WMF reassigned this task from bwang to KSarabia-WMF.Dec 3 2024, 4:51 PM

Change #1091749 merged by jenkins-bot:

[operations/mediawiki-config@master] Reenable non-UI experiment quick survey

https://gerrit.wikimedia.org/r/1091749

Mentioned in SAL (#wikimedia-operations) [2024-12-03T21:10:22Z] <ebernhardson@deploy2002> Started scap sync-world: Backport for [[gerrit:1099790|Rerunning Web browser extension survey (T380778)]], [[gerrit:1091749|Reenable non-UI experiment quick survey (T379241)]], [[gerrit:1100138|Deploy Vector22 To Wikis (T381041)]]

Stashbot mentioned this in T381041: Dec 3: Vector 2022 Deployments.Dec 3 2024, 9:10 PM

Mentioned in SAL (#wikimedia-operations) [2024-12-03T21:16:43Z] <ebernhardson@deploy2002> bwang, ebernhardson, lmora, jdrewniak: Backport for [[gerrit:1099790|Rerunning Web browser extension survey (T380778)]], [[gerrit:1091749|Reenable non-UI experiment quick survey (T379241)]], [[gerrit:1100138|Deploy Vector22 To Wikis (T381041)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Maintenance_bot removed a project: Patch-For-Review.Dec 3 2024, 9:31 PM

Mentioned in SAL (#wikimedia-operations) [2024-12-03T21:32:22Z] <ebernhardson@deploy2002> Finished scap sync-world: Backport for [[gerrit:1099790|Rerunning Web browser extension survey (T380778)]], [[gerrit:1091749|Reenable non-UI experiment quick survey (T379241)]], [[gerrit:1100138|Deploy Vector22 To Wikis (T381041)]] (duration: 22m 00s)

Justin confirmed people are getting the survey

SToyofuku-WMF reassigned this task from KSarabia-WMF to ovasileva.Dec 4 2024, 6:09 PM

SToyofuku-WMF added a subscriber: KSarabia-WMF.

@ovasileva as part of signoff - when should this be turned off?

Ready to turn off. Moving back to Ready

I will disable the Google form API survey and the browser extension as well as potentially night mode for Italian.

Change #1101574 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[operations/mediawiki-config@master] Disable QuickSurveys for recommendations

https://gerrit.wikimedia.org/r/1101574

gerritbot added a project: Patch-For-Review.Dec 9 2024, 6:47 PM

Change #1101574 merged by jenkins-bot:

[operations/mediawiki-config@master] Disable QuickSurveys for recommendations

https://gerrit.wikimedia.org/r/1101574

Mentioned in SAL (#wikimedia-operations) [2024-12-09T21:47:06Z] <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1101574|Disable QuickSurveys for recommendations (T379241 T380778)]]

Mentioned in SAL (#wikimedia-operations) [2024-12-09T21:51:11Z] <cjming@deploy2002> cjming, jdlrobson: Backport for [[gerrit:1101574|Disable QuickSurveys for recommendations (T379241 T380778)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-12-09T21:57:22Z] <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1101574|Disable QuickSurveys for recommendations (T379241 T380778)]] (duration: 10m 15s)

Surveys have been disabled.

Maintenance_bot removed a project: Patch-For-Review.Dec 9 2024, 10:32 PM

ovasileva closed this task as Resolved.Thu, Dec 12, 1:41 PM

Set up quicksurveys for non-UI experiment pt 2Closed, ResolvedPublic1 Estimated Story PointsActions