Difference: CosmoAMPEL (1 vs. 3)

Revision 32017-12-15 - ValeryBrinnel

Line: 1 to 1
 
META TOPICPARENT name="CosmologyWorkingGroup"

AMPEL : Alert Management, Photometry and Estimation of Lightcurves

Line: 31 to 31
 
META FILEATTACHMENT attachment="tiers_intro.png" attr="" comment="Introduction to tiers" date="1513327007" name="tiers_intro.png" path="tiers_intro.png" size="634955" stream="tiers_intro.png" user="Main.JakobNordin" version="3"
META FILEATTACHMENT attachment="tiers_technical.png" attr="" comment="Technical tier overview" date="1513327570" name="tiers_technical.png" path="tiers_technical.png" size="122802" stream="tiers_technical.png" user="Main.JakobNordin" version="1"
META FILEATTACHMENT attachment="ampel_berlindec17.pdf" attr="" comment="Motivation and overview, Dec 2017" date="1513329146" name="ampel_berlindec17.pdf" path="ampel_berlindec17.pdf" size="777837" stream="ampel_berlindec17.pdf" user="Main.JakobNordin" version="1"
Changed:
<
<
META FILEATTACHMENT attachment="Ampel_Zeuthen_0.2.pdf" attr="" comment="Design implementation" date="1513329192" name="Ampel_Zeuthen_0.2.pdf" path="Ampel_Zeuthen_0.2.pdf" size="1569453" stream="Ampel_Zeuthen_0.2.pdf" user="Main.JakobNordin" version="1"
>
>
META FILEATTACHMENT attachment="Ampel_Zeuthen_0.2.pdf" attr="" comment="Ampel Implementation" date="1513377369" name="Ampel_Zeuthen_0.2.pdf" path="Ampel_Zeuthen_0.2.pdf" size="1271761" stream="Ampel_Zeuthen_0.2.pdf" user="Main.ValeryBrinnel" version="1"

Revision 22017-12-15 - JakobNordin

Line: 1 to 1
 
META TOPICPARENT name="CosmologyWorkingGroup"

AMPEL : Alert Management, Photometry and Estimation of Lightcurves

Changed:
<
<
A new era of wide-field optical photometric surveys will detect more astronomical transients than can be selected for detailed study, let alone be visually inspected in real-time. This will be implemented as continuous streams of alerts that are distributed by brokers. Astronomers, that previously could monitor a limited pool of nightly transients, are now tasked with processing alerts based on a limited set of detection statistics. AMPEL is designed as a flexible and powerful tool for not only completing this initial selection process, but also for the continuous monitoring of active transients and automatic selection of transients for further observations and/or analysis.

A user of AMPEL provides implementations of two simple python classes. The first (Tier 0) specifies alert selection criteria for potentially interesting candidates. These can range from simple (magnitude beyond threshold) to complex (detections in multiple filter, minimal mag diff with time and coincidental with the position of external triggers like GW, neutrinos or gamma-rays). The second (Tier 3) specifies how live candidates should be ranked and allows automatic action to be taken based on these. Ranking can be based on the raw photometry available in the alerts, but also incorporate added information such as photometric redshift, photometric classification, projected peak time/magnitude and visibility at a specific telescope site. The ranked list of transients can be the basis for e-mail alerts or automatic circulars, or downloaded as the recommended target list for follow-up facilities.

  • Introduction to tiers:
    tiers_intro.png
>
>
We will try to keep and update an introduction to AMPEL here, check back in early Jan for more info.
 
Changed:
<
<
The AMPEL pipeline will provide two automatic layers: continuous monitoring of all transients tagged as interesting by users, and derivation of additional transient information for these. The monitoring step keeps track of new alerts where the same transient was rediscovered as well as survey non-detections. These will be critical as transients can be observed but not fulfill all criteria necessary for triggering new alerts. The final AMPEL deruvation layer provides a convenient framework for adding transient information based on external and updated photometric data. Already planned modules include for host galaxy photometric redshifts, comparisons with transient template lightcurves and photometric typing algorithms, but all user can and are encouraged to contribute further modules. These can, but must not, be made available to other users.

AMPEL will have unique capabilities to deliver transient samples with well understood selection functions and background estimates. In an era where large number of transients are detected, the limiting factor in understanding the astrophysical populations will shift to quantifying the transient fraction that was not fully observed. AMPEL accomplishes this through two key design features: First, it is possible to design a fully automatic transient survey, limiting the non-tractable human intervention to a minimum. Secondly, the full pipeline exists in a container instance. This will not only allow the exact survey sequence to be generated at later times, but also allows multiple simulated versions of the executed survey to be easily completed. This can conveniently provide answers to questions such as what sample would have been observed with infinite spectroscopic resources or more generous selection criteria.

AMPEL is developed at HU berlin and will be initially deployed at the DESY-Zeuthen computer cluster. It consistently keeps track on user rights both to software and data, and seamlessly integrates updated calibration solutions into the derived properties. Code documentation is available at the AmpelProject GitHub. This will contain the base Tier abstract classes as well as sample implementations and directories where users can submit their code for testing and implementation. We will during the testing phase restrict the number of users and you will have to contact JakobNordin or Valery Brinnel to get repository access.

>
>
A new era of wide-field optical photometric surveys will detect more astronomical transients than can be selected for detailed study, let alone be visually inspected in real-time. This will be implemented as continuous streams of alerts that are distributed by brokers. Astronomers, that previously could monitor a limited pool of nightly transients, are now tasked with processing alerts based on a limited set of detection statistics. AMPEL is designed as a flexible and powerful tool for not only completing this initial selection process, but also for the continuous monitoring of active transients and automatic selection of transients for further observations and/or analysis.
 
Changed:
<
<
  • Technical tier overview:
    tiers_technical.png
>
>
Code documentation is available at the AmpelProject GitHub. This will contain the base Tier abstract classes as well as sample implementations and directories where users can submit their code for testing and implementation. We will during the testing phase restrict the number of users and you will have to contact JakobNordin or Valery Brinnel to get repository access.
 

AMPEL Workshop Berlin 12/13th Dec 2017

Line: 25 to 14
 Members of the Berlin, Weizmann and OKC met up to discuss science requirements for different ZTF projects, what software are required to achieve this and how AMPEL can be used to run these in a consistent and convenient way. Smaller groups were formed to discuss requirements on Star/Galaxy separation, host galaxy identification and TNS/Wiserep integration. We will work together to implement an early SN trigger with minimal scanning requirements.

Main steps of the time-line for the next months development work:

Changed:
<
<
  • Dec 2017: API release for T0 and T3, together with simple sample implementations.
>
>
  • Dec 2017: T0 filter examples and T3 configuration examples.
 
  • Mid Jan 2018: Sample sandbox stream to TNS and Marshal; container pipeline version.
  • End Jan 2018: Full processing of UW stream; rejected transient DB.

Revision 12017-12-15 - JakobNordin

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="CosmologyWorkingGroup"

AMPEL : Alert Management, Photometry and Estimation of Lightcurves

A new era of wide-field optical photometric surveys will detect more astronomical transients than can be selected for detailed study, let alone be visually inspected in real-time. This will be implemented as continuous streams of alerts that are distributed by brokers. Astronomers, that previously could monitor a limited pool of nightly transients, are now tasked with processing alerts based on a limited set of detection statistics. AMPEL is designed as a flexible and powerful tool for not only completing this initial selection process, but also for the continuous monitoring of active transients and automatic selection of transients for further observations and/or analysis.

A user of AMPEL provides implementations of two simple python classes. The first (Tier 0) specifies alert selection criteria for potentially interesting candidates. These can range from simple (magnitude beyond threshold) to complex (detections in multiple filter, minimal mag diff with time and coincidental with the position of external triggers like GW, neutrinos or gamma-rays). The second (Tier 3) specifies how live candidates should be ranked and allows automatic action to be taken based on these. Ranking can be based on the raw photometry available in the alerts, but also incorporate added information such as photometric redshift, photometric classification, projected peak time/magnitude and visibility at a specific telescope site. The ranked list of transients can be the basis for e-mail alerts or automatic circulars, or downloaded as the recommended target list for follow-up facilities.

  • Introduction to tiers:
    tiers_intro.png

The AMPEL pipeline will provide two automatic layers: continuous monitoring of all transients tagged as interesting by users, and derivation of additional transient information for these. The monitoring step keeps track of new alerts where the same transient was rediscovered as well as survey non-detections. These will be critical as transients can be observed but not fulfill all criteria necessary for triggering new alerts. The final AMPEL deruvation layer provides a convenient framework for adding transient information based on external and updated photometric data. Already planned modules include for host galaxy photometric redshifts, comparisons with transient template lightcurves and photometric typing algorithms, but all user can and are encouraged to contribute further modules. These can, but must not, be made available to other users.

AMPEL will have unique capabilities to deliver transient samples with well understood selection functions and background estimates. In an era where large number of transients are detected, the limiting factor in understanding the astrophysical populations will shift to quantifying the transient fraction that was not fully observed. AMPEL accomplishes this through two key design features: First, it is possible to design a fully automatic transient survey, limiting the non-tractable human intervention to a minimum. Secondly, the full pipeline exists in a container instance. This will not only allow the exact survey sequence to be generated at later times, but also allows multiple simulated versions of the executed survey to be easily completed. This can conveniently provide answers to questions such as what sample would have been observed with infinite spectroscopic resources or more generous selection criteria.

AMPEL is developed at HU berlin and will be initially deployed at the DESY-Zeuthen computer cluster. It consistently keeps track on user rights both to software and data, and seamlessly integrates updated calibration solutions into the derived properties. Code documentation is available at the AmpelProject GitHub. This will contain the base Tier abstract classes as well as sample implementations and directories where users can submit their code for testing and implementation. We will during the testing phase restrict the number of users and you will have to contact JakobNordin or Valery Brinnel to get repository access.

  • Technical tier overview:
    tiers_technical.png

AMPEL Workshop Berlin 12/13th Dec 2017

Members of the Berlin, Weizmann and OKC met up to discuss science requirements for different ZTF projects, what software are required to achieve this and how AMPEL can be used to run these in a consistent and convenient way. Smaller groups were formed to discuss requirements on Star/Galaxy separation, host galaxy identification and TNS/Wiserep integration. We will work together to implement an early SN trigger with minimal scanning requirements.

Main steps of the time-line for the next months development work:

  • Dec 2017: API release for T0 and T3, together with simple sample implementations.
  • Mid Jan 2018: Sample sandbox stream to TNS and Marshal; container pipeline version.
  • End Jan 2018: Full processing of UW stream; rejected transient DB.

You can find the overview slides presented here:

-- JakobNordin - 15 Dec 2017

META FILEATTACHMENT attachment="tiers_intro.png" attr="" comment="Introduction to tiers" date="1513327007" name="tiers_intro.png" path="tiers_intro.png" size="634955" stream="tiers_intro.png" user="Main.JakobNordin" version="3"
META FILEATTACHMENT attachment="tiers_technical.png" attr="" comment="Technical tier overview" date="1513327570" name="tiers_technical.png" path="tiers_technical.png" size="122802" stream="tiers_technical.png" user="Main.JakobNordin" version="1"
META FILEATTACHMENT attachment="ampel_berlindec17.pdf" attr="" comment="Motivation and overview, Dec 2017" date="1513329146" name="ampel_berlindec17.pdf" path="ampel_berlindec17.pdf" size="777837" stream="ampel_berlindec17.pdf" user="Main.JakobNordin" version="1"
META FILEATTACHMENT attachment="Ampel_Zeuthen_0.2.pdf" attr="" comment="Design implementation" date="1513329192" name="Ampel_Zeuthen_0.2.pdf" path="Ampel_Zeuthen_0.2.pdf" size="1569453" stream="Ampel_Zeuthen_0.2.pdf" user="Main.JakobNordin" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2025 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback