Difference: NEOZTFScanning (1 vs. 12)

Revision 122019-01-25 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 24 to 24
 

Streak Detection Workflow Process

Changed:
<
<
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done
>
>
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done
 
Changed:
<
<
(2) Go to the review page to check for candidates http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi
>
>
(2) Go to the review page to check for candidates http://private.caltech.edu:8088/zstreak/review2.cgi
 
  • Username = ztfss
  • Password = 2018cl (note that this is a lowercase L)
Line: 34 to 34
 
    • This page may take a few minutes to fully load depending on number of candidates and your internet connection speed
    • How-to document can be found here.
Changed:
<
<
    • Using radio buttons, mark real Accepted candidates with "Acpt", leave bad Rejected candidates with "Rej". UPDATE, 24 Aug 2018: Mark any uncertain candidates with "Acpt". These will be further vetted by the Shepherd, so do not worry about accepting something that might not be real.
    • There are usually several thousand candidates per night, and the vast majority will be bad/rejected
    • You can limit how many stamps you see each time by adding a "maxStamps" parameter, like http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi?maxStamps=2000 . These will be ordered by the ML score so those with higher scores will appear first.
>
>
    • Using radio buttons, mark real Accepted candidates with "Acpt", leave bad Rejected candidates with "Rej". Mark any uncertain candidates with "Acpt". These will be further vetted by the Shepherd, so do not worry about accepting something that might not be real.
    • UPDATE 25 Jan 2019: There are usually around a thousand candidates per night, and the majority will be bad/rejected. The new Deep Streaks technique implemented by QZ has substantially decreased the number of candidates that need to be scanned nightly.
  (3) Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit

  • This will put the accepted candidates on a separate web page
Changed:
<
<
http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/shepherd.cgi
>
>
http://private.caltech.edu:8088/zstreak/shepherd.cgi
 
Changed:
<
<
  • For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center
>
>
  • For now (as of January 2019), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center
 

ZMODE Workflow Process

Line: 51 to 50
 

Personnel

Changed:
<
<
As of August 2018, the folks currently working on this are:
>
>
As of January 2019, the folks currently working on this are:
 
Added:
>
>
 

Other helpful resources

Minor Planet Center Near Earth Object Confirmation Page

  • The objects on this page that were discovered by ZTF have names starting with "ZTF"
Changed:
<
<
List of Follow Up Observatories
>
>
List of Follow Up Observatories
 
  • Information about follow up observatories for NEOs discovered by ZTF
Changed:
<
<
-- Emily Kramer - 2018-10-26
>
>
-- Emily Kramer - 2019-01-25

Revision 112018-10-26 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 14 to 14
  (1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones. Go here for the Scanner page, including sign up sheet and instructions
Changed:
<
<
(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need. Go here for the Shepherd page, including sign up sheet and instructions
>
>
(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need. Go here for the Shepherd page, including sign up sheet and instructions
  (3) Gatekeeper: person who will submit real asteroid streaks to the Minor Planet Center, and will have the final say in what is real or not. Currently, only QZ is in this role.
Line: 33 to 33
 
    • This page may take a few minutes to fully load depending on number of candidates and your internet connection speed
Changed:
<
<
>
>
 
    • Using radio buttons, mark real Accepted candidates with "Acpt", leave bad Rejected candidates with "Rej". UPDATE, 24 Aug 2018: Mark any uncertain candidates with "Acpt". These will be further vetted by the Shepherd, so do not worry about accepting something that might not be real.
    • There are usually several thousand candidates per night, and the vast majority will be bad/rejected
    • You can limit how many stamps you see each time by adding a "maxStamps" parameter, like http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi?maxStamps=2000 . These will be ordered by the ML score so those with higher scores will appear first.
Line: 64 to 64
 Minor Planet Center Near Earth Object Confirmation Page
  • The objects on this page that were discovered by ZTF have names starting with "ZTF"
Changed:
<
<
List of Follow Up Observatories
>
>
List of Follow Up Observatories
 
  • Information about follow up observatories for NEOs discovered by ZTF
Deleted:
<
<
-- EmilyKramer - 24 Aug 2018
 \ No newline at end of file
Added:
>
>
-- Emily Kramer - 2018-10-26

Revision 102018-10-06 - QuanzhiYe

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 12 to 12
  There are three different roles to be filled for processing the streak data, with different levels of responsibility for each. We can iterate on terminology and precise roles, but here's the rough sketch:
Changed:
<
<
(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones. Go here for the Scanner page, including sign up sheet and instructions
>
>
(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones. Go here for the Scanner page, including sign up sheet and instructions
  (2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need. Go here for the Shepherd page, including sign up sheet and instructions
Line: 34 to 31
 
  • Username = ztfss
  • Password = 2018cl (note that this is a lowercase L)
Added:
>
>
 
    • This page may take a few minutes to fully load depending on number of candidates and your internet connection speed
    • How-to document can be found here.
    • Using radio buttons, mark real Accepted candidates with "Acpt", leave bad Rejected candidates with "Rej". UPDATE, 24 Aug 2018: Mark any uncertain candidates with "Acpt". These will be further vetted by the Shepherd, so do not worry about accepting something that might not be real.
Line: 47 to 45
 
  • For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center
Deleted:
<
<
 

ZMODE Workflow Process

Deleted:
<
<
to be filled in later after more discussion with QZ --EK
 
Added:
>
>
to be filled in later after more discussion with QZ --EK
 

Personnel

Added:
>
>
 As of August 2018, the folks currently working on this are:

Revision 92018-08-24 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 36 to 36
 
    • This page may take a few minutes to fully load depending on number of candidates and your internet connection speed
    • How-to document can be found here.
Changed:
<
<
    • Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; it is better to leave "gray-area" cases than to reject them. That is to say, if you are unsure, do not reject a candidate.
>
>
    • Using radio buttons, mark real Accepted candidates with "Acpt", leave bad Rejected candidates with "Rej". UPDATE, 24 Aug 2018: Mark any uncertain candidates with "Acpt". These will be further vetted by the Shepherd, so do not worry about accepting something that might not be real.
 
Line: 73 to 73
 
Changed:
<
<
-- EmilyKramer - 13 Aug 2018
>
>
-- EmilyKramer - 24 Aug 2018
 \ No newline at end of file

Revision 82018-08-13 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 38 to 38
 
    • How-to document can be found here.
    • Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; it is better to leave "gray-area" cases than to reject them. That is to say, if you are unsure, do not reject a candidate.
    • There are usually several thousand candidates per night, and the vast majority will be bad/rejected
Added:
>
>
  (3) Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit
Line: 60 to 61
 
Added:
>
>
 

Other helpful resources

Line: 71 to 73
 
Changed:
<
<
-- EmilyKramer - 10 Aug 2018
>
>
-- EmilyKramer - 13 Aug 2018

Revision 72018-08-10 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 46 to 46
 
  • For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center
Added:
>
>

ZMODE Workflow Process

to be filled in later after more discussion with QZ --EK

Personnel

As of August 2018, the folks currently working on this are:
 

Other helpful resources

Minor Planet Center Near Earth Object Confirmation Page

  • The objects on this page that were discovered by ZTF have names starting with "ZTF"
Added:
>
>
List of Follow Up Observatories
  • Information about follow up observatories for NEOs discovered by ZTF
 

Revision 62018-08-10 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"

NEOZTF Scanning Overview

Line: 36 to 36
 
    • This page may take a few minutes to fully load depending on number of candidates and your internet connection speed
    • How-to document can be found here.
Changed:
<
<
    • Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; better to be conservative with rejecting things
>
>
    • Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; it is better to leave "gray-area" cases than to reject them. That is to say, if you are unsure, do not reject a candidate.
 
    • There are usually several thousand candidates per night, and the vast majority will be bad/rejected
Added:
>
>
 (3) Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit

  • This will put the accepted candidates on a separate web page

Revision 52018-08-10 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"
Changed:
<
<

Overview

>
>

NEOZTF Scanning Overview

  The purpose of this page is to allow NEOZTF team members to coordinate the daily scanning of the data to ensure that it is done in a timely fashion.
Line: 12 to 12
  There are three different roles to be filled for processing the streak data, with different levels of responsibility for each. We can iterate on terminology and precise roles, but here's the rough sketch:
Changed:
<
<
(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones. Go here for the Scanner page, including sign up sheet and instructions
>
>
(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones. Go here for the Scanner page, including sign up sheet and instructions
 
Changed:
<
<
(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need. Go here for the Shepherd page, including sign up sheet and instructions
>
>
(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need. Go here for the Shepherd page, including sign up sheet and instructions
 
Changed:
<
<
(3) Gatekeeper: person who will submit real asteroid streaks to the Minor Planet Center, and will have the final say in what is real or not. Currently, only QZ is in this role.
>
>
(3) Gatekeeper: person who will submit real asteroid streaks to the Minor Planet Center, and will have the final say in what is real or not. Currently, only QZ is in this role.
  The idea behind splitting the work in to different roles is that we can initially train new people as Scanners, then once they have more experience they may move up to the Shepherd role. This will alleviate the amount of work that the Gatekeeper needs to do, so that they can focus on just processing the real streaking asteroids to send to the MPC. The Gatekeeper role will be very restricted, and will remain just QZ for the time being, with perhaps me being added later once QZ is comfortable with that.

Line: 27 to 27
 

Streak Detection Workflow Process

Changed:
<
<
  1. Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done
  2. Go to the review page to check for candidates http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi
>
>
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done

(2) Go to the review page to check for candidates http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi

 
  • Username = ztfss
  • Password = 2018cl (note that this is a lowercase L)
Line: 37 to 38
 
    • How-to document can be found here.
    • Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; better to be conservative with rejecting things
    • There are usually several thousand candidates per night, and the vast majority will be bad/rejected
Changed:
<
<
  1. Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit
>
>
(3) Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit
 
Changed:
<
<
(3a) This will put the accepted candidates on a separate web page
>
>
  • This will put the accepted candidates on a separate web page
  http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/shepherd.cgi
Changed:
<
<
(3b) For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center
>
>
  • For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center

Other helpful resources

Minor Planet Center Near Earth Object Confirmation Page

  • The objects on this page that were discovered by ZTF have names starting with "ZTF"

  -- EmilyKramer - 10 Aug 2018

Revision 42018-08-10 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"
Changed:
<
<
Overview
>
>

Overview

  The purpose of this page is to allow NEOZTF team members to coordinate the daily scanning of the data to ensure that it is done in a timely fashion.
Line: 8 to 8
  The original scanning spreadsheet with all the relevant info is here: Scanning Help. I plan to migrate that information all to this page once things are up and running.
Changed:
<
<
Roles to be filled
>
>

Roles to be filled

  There are three different roles to be filled for processing the streak data, with different levels of responsibility for each. We can iterate on terminology and precise roles, but here's the rough sketch:
Line: 25 to 25
 
Changed:
<
<
Streak Detection Workflow Process
>
>

Streak Detection Workflow Process

 
Changed:
<
<
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done
>
>
  1. Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done
  2. Go to the review page to check for candidates http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi
 
Changed:
<
<
(2) Go to the review page to check for candidateshttp://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi Username = ***** Password = *****
>
>
  • Username = ztfss
  • Password = 2018cl (note that this is a lowercase L)
 
Changed:
<
<
(2a) This page may take a few minutes to fully load depending on number of candidates and your internet connection speed

(2b) How-to document can be found on GitHub (New Twiki Version here, still a work in progress)

https://github.com/ZwickyTransientFacility/ZTFSolarSystemMarshal/blob/master/cgi-bin/zsrs/howto.md

(2c) Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; better to be conservative with rejecting things

(2d) There are usually several thousand candidates per night, and the vast majority will be bad/rejected

(3) Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit

>
>
    • This page may take a few minutes to fully load depending on number of candidates and your internet connection speed
    • How-to document can be found here.
    • Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; better to be conservative with rejecting things
    • There are usually several thousand candidates per night, and the vast majority will be bad/rejected
  1. Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit
  (3a) This will put the accepted candidates on a separate web page http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/shepherd.cgi

(3b) For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center

Changed:
<
<
-- EmilyKramer - 06 Aug 2018
>
>
-- EmilyKramer - 10 Aug 2018

Revision 32018-08-06 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"
Overview
Line: 12 to 12
  There are three different roles to be filled for processing the streak data, with different levels of responsibility for each. We can iterate on terminology and precise roles, but here's the rough sketch:
Changed:
<
<
(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones
>
>
(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones. Go here for the Scanner page, including sign up sheet and instructions
 
Changed:
<
<
(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need.
>
>
(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need. Go here for the Shepherd page, including sign up sheet and instructions
  (3) Gatekeeper: person who will submit real asteroid streaks to the Minor Planet Center, and will have the final say in what is real or not. Currently, only QZ is in this role.

Line: 23 to 23
 The Scanner is meant to just do a first cut tossing out of bad candidates, leaving anything remotely plausible for the Shepherd to review. We could potentially have a number of different Scanners each night, since there will be one Shepherd to smooth over any non-uniformities in the way that each Scanner vets the data.

Deleted:
<
<
Shepherding Sign Up

Day of Week Date Shepherd Name Unavailable
M 6 Aug 2018 --- test
  7 Aug 2018 --- test
W 8 Aug 2018 --- test
  9 Aug 2018 --- test
F 10 Aug 2018 --- test
  11 Aug 2018 --- test
  12 Aug 2018 --- test
M 13 Aug 2018 --- test
  14 Aug 2018 --- test
W 15 Aug 2018 --- test
  16 Aug 2018 --- test
F 17 Aug 2018 --- test
  18 Aug 2018 --- test
  19 Aug 2018 --- test
M 20 Aug 2018 --- test
  21 Aug 2018 --- test
W 22 Aug 2018 --- test
  23 Aug 2018 --- test
F 24 Aug 2018 --- test
  25 Aug 2018 --- test
  26 Aug 2018 --- test
 

Streak Detection Workflow Process

Changed:
<
<
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran To do this, go to the marshall page; if it is blank, there is no processing to be done http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi
>
>
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran. To do this, go to the marshall page; if it is blank, there is no processing to be done
 
Changed:
<
<
(2) Go to the review page to check for candidates http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi
>
>
(2) Go to the review page to check for candidateshttp://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi
  Username = ***** Password = *****

(2a) This page may take a few minutes to fully load depending on number of candidates and your internet connection speed

Changed:
<
<
(2b) How-to document can be found on GitHub
>
>
(2b) How-to document can be found on GitHub (New Twiki Version here, still a work in progress)
  https://github.com/ZwickyTransientFacility/ZTFSolarSystemMarshal/blob/master/cgi-bin/zsrs/howto.md

Changed:
<
<
(2c) Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?"; The ones marked as ? will stay on the page for further vetting; better to be conservative with rejecting things
>
>
(2c) Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?". The ones marked as "?" will stay on the page for further vetting; better to be conservative with rejecting things
  (2d) There are usually several thousand candidates per night, and the vast majority will be bad/rejected

Line: 77 to 48
 (3a) This will put the accepted candidates on a separate web page http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/shepherd.cgi

Changed:
<
<
(3b) For now (as of mid June 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center

Scanner Duties

(1) Go to the scanning page and check for candidates.

(2) Follow these instructions on how to vet candidates. NOTE: I PLAN TO MOVE THIS INFORMATION DIRECTLY TO THIS PAGE OR A SUB-PAGE SO THAT PEOPLE DO NOT HAVE TO GO TO MULTIPLE WEBSITES

Shepherd Duties

Tasks to be completed each day by the Shepherd (note that this is a work in progress)

(1) Follow the Streak Detection Workflow Process

(2) Follow the ZMODE Workflow Process (this has not yet been written, will be done later)

(3) Check the NEOCP for any ZTF discovered objects

(3a) If there are any that are in danger of being lost due to increasing orbital uncertainty contact appropriate observatory to encourage follow up

(3b) Check if any have gotten an MPEC, or were determined to not be NEOs

(4) Update tally page (this has not yet been written, will be done later)

(4a) This will have statistics on it including number of candiate streak, number of real asteroids, etc

>
>
(3b) For now (as of August 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center
  -- EmilyKramer - 06 Aug 2018

Revision 22018-08-06 - EmilyKramer

Line: 1 to 1
 
META TOPICPARENT name="SolarSystemWorkingGroup"
Overview
Line: 49 to 49
 
  26 Aug 2018 --- test
Added:
>
>
Streak Detection Workflow Process
 
Added:
>
>
(1) Check to see if data was collected on the previous night, and that the streak detection pipeline properly ran To do this, go to the marshall page; if it is blank, there is no processing to be done http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi

(2) Go to the review page to check for candidates http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/review.cgi Username = ***** Password = *****

(2a) This page may take a few minutes to fully load depending on number of candidates and your internet connection speed

(2b) How-to document can be found on GitHub

https://github.com/ZwickyTransientFacility/ZTFSolarSystemMarshal/blob/master/cgi-bin/zsrs/howto.md

(2c) Using radio buttons, mark real Accepted candidates with "A", leave bad Rejected candidates with "R", and mark uncertain ones with "?"; The ones marked as ? will stay on the page for further vetting; better to be conservative with rejecting things

(2d) There are usually several thousand candidates per night, and the vast majority will be bad/rejected

(3) Once done reviewing candidates, select your name from the drop-down box at the bottom of the page, and hit Submit

(3a) This will put the accepted candidates on a separate web page http://yupana.caltech.edu/cgi-bin/ptf/ssm/zsrs/shepherd.cgi

(3b) For now (as of mid June 2018), QZ will then manually analyze each real candidate to link detections together and get astrometry to be sent to the Minor Planet Center

Scanner Duties

(1) Go to the scanning page and check for candidates.

(2) Follow these instructions on how to vet candidates. NOTE: I PLAN TO MOVE THIS INFORMATION DIRECTLY TO THIS PAGE OR A SUB-PAGE SO THAT PEOPLE DO NOT HAVE TO GO TO MULTIPLE WEBSITES

Shepherd Duties

Tasks to be completed each day by the Shepherd (note that this is a work in progress)

(1) Follow the Streak Detection Workflow Process

(2) Follow the ZMODE Workflow Process (this has not yet been written, will be done later)

(3) Check the NEOCP for any ZTF discovered objects

(3a) If there are any that are in danger of being lost due to increasing orbital uncertainty contact appropriate observatory to encourage follow up

(3b) Check if any have gotten an MPEC, or were determined to not be NEOs

(4) Update tally page (this has not yet been written, will be done later)

(4a) This will have statistics on it including number of candiate streak, number of real asteroids, etc

  -- EmilyKramer - 06 Aug 2018

Revision 12018-08-06 - EmilyKramer

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="SolarSystemWorkingGroup"
Overview

The purpose of this page is to allow NEOZTF team members to coordinate the daily scanning of the data to ensure that it is done in a timely fashion.

Since I am new to using twiki, please let me know if there are any problems with links.

The original scanning spreadsheet with all the relevant info is here: Scanning Help. I plan to migrate that information all to this page once things are up and running.

Roles to be filled

There are three different roles to be filled for processing the streak data, with different levels of responsibility for each. We can iterate on terminology and precise roles, but here's the rough sketch:

(1) Scanner: person who looks at the candidate streaks, and rejects obviously bad candidates. This will eventually hopefully be done throughout the night by team members in different time zones

(2) Shepherd: person who looks at the remaining non-rejected candidates in the morning, and processes the data. They will be in charge of marking candidates as "real", and will have other duties including monitoring the NEOCP to make sure that our discoveries are getting the follow up they need.

(3) Gatekeeper: person who will submit real asteroid streaks to the Minor Planet Center, and will have the final say in what is real or not. Currently, only QZ is in this role.

The idea behind splitting the work in to different roles is that we can initially train new people as Scanners, then once they have more experience they may move up to the Shepherd role. This will alleviate the amount of work that the Gatekeeper needs to do, so that they can focus on just processing the real streaking asteroids to send to the MPC. The Gatekeeper role will be very restricted, and will remain just QZ for the time being, with perhaps me being added later once QZ is comfortable with that.

The Scanner is meant to just do a first cut tossing out of bad candidates, leaving anything remotely plausible for the Shepherd to review. We could potentially have a number of different Scanners each night, since there will be one Shepherd to smooth over any non-uniformities in the way that each Scanner vets the data.

Shepherding Sign Up

Day of Week Date Shepherd Name
<-- -->
Unavailable
M 6 Aug 2018 --- test
  7 Aug 2018 --- test
W 8 Aug 2018 --- test
  9 Aug 2018 --- test
F 10 Aug 2018 --- test
  11 Aug 2018 --- test
  12 Aug 2018 --- test
M 13 Aug 2018 --- test
  14 Aug 2018 --- test
W 15 Aug 2018 --- test
  16 Aug 2018 --- test
F 17 Aug 2018 --- test
  18 Aug 2018 --- test
  19 Aug 2018 --- test
M 20 Aug 2018 --- test
  21 Aug 2018 --- test
W 22 Aug 2018 --- test
  23 Aug 2018 --- test
F 24 Aug 2018 --- test
  25 Aug 2018 --- test
  26 Aug 2018 --- test

-- EmilyKramer - 06 Aug 2018

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2025 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback