Difference: MarshalFAQs (1 vs. 19)

I have used the GROWTH marshal to write my paper. How do I acknowledge this?

If the GROWTH Marshal assisted you in writing your paper, you can use the following acknowledgement sentence: This paper used the GROWTH marshal (Kasliwal et al. 2018) to filter alerts and co-ordinate follow-up. The GROWTH project is funded by the National Science Foundation under PIRE Grant No 1545949.

Technical Questions

I forgot my password. What do I do?

You can reset your password by going to this link http://skipper.caltech.edu:8080/cgi-bin/growth/forget_pwd.html Once a reset is requested, an email will be sent to the address the user registered with.

How can I contact the GROWTH marshal team?

this Google form

• GROWTHMarshal.pdf: GROWTH Marshal Talk at ZTF Team Meeting (March 2018)

How do I ingest AVRO packets into my science program by ID?

Please, see this document.

filteron bright and noPointUnderneath and (not mover) and real and positiveSubtraction and (not brightStar);

How do I create a new science program?

Where do I create a wishlist?

Where do I create a wishlist?

Each science working group should create a prioritized wishlist and email link to contact_growth. For example, the BH SWG has a wishlist here.

General Questions

Who do I contact to join an existing science program?

Can I be a member of multiple science programs?

Can one transient be part of multiple science programs?

What else do I need to know about the science programs on the marshal?

Can I add a source manually?

How do I tune thresholds in my science filters?

What do I need to know about rejected candidates?

Where can I find more information about source summaries and automated annotations?

General Questions (Sign up, accounts, etc)

How do I sign up to the GROWTH marshal?

Everyone who wants to use the GROWTH Marshal can sign up on the following page

https://zwicky.tf/wg6

Marshal accounts need to be approved by the marshal administrators.

What is the marshal homepage?

Please bookmark this URL for access to the homepage of the GROWTH marshal

https://zwicky.tf/qru

Note that to access this page you need to have your account approved by the marshal administrators. New accounts are reviewed and processed on a daily basis.

I forgot my password, what do I do?

Please, contact (tbd) t request a reset of your password

Who do I contact with requests related to a particular science program?

Please, contact the PI of the science program you are interested in. The contact info for the PIs of science programs is available TBD.

What should I do if I want to join the ZTF Science Validation Program?

Please email TBD if you would like to join the "ZTF Science Validation" Science Program. This is the mode in which we are operating now. If you want to help with scanning or follow-up, please sign up. Please add your scanning availability to the "Calendar" and/or your observing runs to the follow-up.

Marshal Operations

I participate in science validation. What do I need to know?

Science ValidationThose of you participating in the science validation can see that targets are flowing end-to-end i.e. IPAC avro packets are passing through marshal filters, being saved as sources, being assigned to follow-up runs, etc. You can "view report" on some supernova candidates, some CV/QSO candidates, some hostless candidates here: http://skipper.caltech.edu:8080/cgi-bin/growth/list_sources_growth.cgi?programidx=1

What do I need to know about the science programs on the marshal?

Each science program on the marshal has a designated PI. The PI of a science program is responsible for adding members to the program (they should be added to the program themselves). Any member of the Science program can edit filters, transfer sources, organize follow-up, add annotations, add auto-annotations etc.

If you would like to set up a script that auto-annotates sources in your science program, please email contact_growth with the field name, field datatype and and field definition. This is to avoid redundant auto-annotations.

????

What do I need to know about rejected candidates?

The machine learning group is looking for feedback from scanners especially on rejected candidates. We will shortly set up a rejected candidates table where you can select a reason for rejection.

What do I need to know about marshal filters?

We have implemented filters that each science program can customize. In data science, this is called "in-situ beamline triggers" (just learned this term at a talk this morning by Alex Szalay). We will be listening to the entire AVRO stream from ZTF but only candidates that pass at least one of the filters of the science programs get saved to the database and listed on the scanning page. Candidates are only saved for 5 days. A member of your science working group has to save a candidate as a source if they want to follow it up. You are welcome to use the Calendar functionality to set up a Scanners schedule.

Another option is that sources can be added manually from the "Add Source" page. This is to facilitate that sources from any survey could be of interest for follow-up for the Science Program.

This is a follow-up marshal i.e. when you save a candidate as a source, you are expressing interest in following it up. If you have added zero follow-up data to your source in ~100 days, your sources will be deleted (with a warning message of course). You are encouraged to fine-tune your filters to match your follow-up appetite.

We are continuously tuning the filters to test different parameters - so please be patient - setting up filters appropriately is one of our main goals in science validation. You will see that the scanning pages change when we re-ingest with a new test set of parameters. For example, you will see sources from negative subtractions that are flagged as such with annotation "positiveSubtraction = False". There are currently several examples of candidates where there is transient light in the reference image. We may flag these out in the next iteration for the science validation program but it may be useful for other programs. Another example is that we lowered the realbogus value and found out that sgscore=0.0 for bright, saturated stars. We will attempt to flag these out as well in the next iteration.

Where to find and how to use the spectroscopy finder charts?

For spectroscopy finder charts, please press the "V" symbol on the top right of the view_source page. These are the finder charts from the iPTF variable marshal and relies on absolute astrometry. This is a temporary solution. I am hopeful a ZTF finder chart tool will be ready soon.

Where can I find more information about source summaries and autoannotations?

Please, read this document.

Is SEDM integrated into the marshal?

Thanks to Richard Walters, SEDM is now integrated into the marshal in that you can request follow-up of targets to SEDM. Which of these targets actually get observed will depend on the deliberations of the experiment planning committee on the SEDM White Papers.

Example of a marshal filter

This filter selects transient candidates which are astrophysical (based on rbscore) + not asteroids (two detections) + not stars (no known point source underneath). Once you form a Science Program, you will need to write a custom filter to select candidates that meet your specific science goals. This filter is only an example. Currently, you can write a filter based on any of the information available to you in the P48 avro packet. (Additional parameters from external databases may also become available in the near future, stay tuned)

--
bright = False;
noPointUnderneath = False;
mover = True;
real = False;
slope = 0.0;
t_slope = 0.0;
rb = 0.0;

prevCandidates = observation["prv_candidates"];
m_now = observation["candidate"]["magpsf"];
t_now = observation["candidate"]["jd"];
fid_now = observation["candidate"]["fid"];
sgscore = observation["candidate"]["sgscore"];
rbscore = observation["candidate"]["rb"];

bright = m_now < 99.0;

if (rbscore and rbscore > 0.5) {
   real = True;
}

if (sgscore and sgscore < 0.6) {
   noPointUnderneath = True;
}

for candidate in prevCandidates{
    if (candidate["jd"] and candidate["magpsf"] and candidate["fid"]) {

        dt = t_now - candidate["jd"];
        if (dt > 0.02 and candidate["magpsf"] < 99) {
           mover = False;
        }

        if (dt != 0.0 and candidate["magpsf"] < 99){
            if (candidate["jd"] > t_slope and candidate["fid"] == fid_now) {
               t_slope = candidate["jd"];
               slope = (m_now - candidate["magpsf"]) / dt;
            }
        }
    }
}



annotate "magnitude" m_now;
annotate "sgscore" sgscore;
annotate "slope" slope;
annotate "rbscore" rbscore;

filteron bright and noPointUnderneath and not mover and real;

-- IvaKostadinova - 15 Mar 2018