Welcome to DU!
The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards.
Join the community:
Create a free account
Support DU (and get rid of ads!):
Become a Star Member
Latest Breaking News
Editorials & Other Articles
General Discussion
The DU Lounge
All Forums
Issue Forums
Culture Forums
Alliance Forums
Region Forums
Support Forums
Help & Search
Science
Related: About this forumAstronomers Wake Up to 800,000 Notifications From a Vera Rubin
https://gizmodo.com/astronomers-wake-up-to-800000-notifications-from-observatory-watching-the-night-skies-2000727018The Vera Rubin observatory fired off its first wave of notifications from its new alert system on Tuesday night, sending 800,000 alerts to astronomers computers around the world. The Alert Production Pipeline, a software developed at the University of Washington, is designed to eventually produce up to 7 million alerts per night, documenting celestial events spotted by Rubin.
The scale and speed of the alerts are unprecedented, Hsin-Fang Chiang, a software developer at SLAC National Accelerator Laboratory and lead of operations for data processing at the U.S. Data Facility, said in a statement. After generating hundreds of thousands of test alerts in the last few months, we are now able to say, within minutes, with each image, Here is everything. Go.
snip
The first batch of notifications included detections of supernovae, variable stars, active galactic nuclei, and newly spotted asteroids in the solar system. Each alert signals something that has changed in a patch of the night skies since Rubin last looked, whether its a new source of light, a star that brightened or dimmed, or an object that moved.
A team of researchers and software developers has been working on the Alert Production Pipeline for the past decade, trying to figure out how to process 10 terabytes of images every night. Enabling real-time discovery on such a massive data stream has required years of technical innovation in image processing algorithms, databases and data orchestration, Eric Bellm, (Yes, Bellm. I checked) an astronomy professor at the University of Washington, who leads the Alert Production Pipeline Group for the Rubin Observatory, said in a statement.
The scale and speed of the alerts are unprecedented, Hsin-Fang Chiang, a software developer at SLAC National Accelerator Laboratory and lead of operations for data processing at the U.S. Data Facility, said in a statement. After generating hundreds of thousands of test alerts in the last few months, we are now able to say, within minutes, with each image, Here is everything. Go.
snip
The first batch of notifications included detections of supernovae, variable stars, active galactic nuclei, and newly spotted asteroids in the solar system. Each alert signals something that has changed in a patch of the night skies since Rubin last looked, whether its a new source of light, a star that brightened or dimmed, or an object that moved.
A team of researchers and software developers has been working on the Alert Production Pipeline for the past decade, trying to figure out how to process 10 terabytes of images every night. Enabling real-time discovery on such a massive data stream has required years of technical innovation in image processing algorithms, databases and data orchestration, Eric Bellm, (Yes, Bellm. I checked) an astronomy professor at the University of Washington, who leads the Alert Production Pipeline Group for the Rubin Observatory, said in a statement.
Watcha going to do with a 3,200-megapixel camera?
8 replies
= new reply since forum marked as read
Highlight:
NoneDon't highlight anything
5 newestHighlight 5 most recent replies
Astronomers Wake Up to 800,000 Notifications From a Vera Rubin (Original Post)
usonian
18 hrs ago
OP
lastlib
(27,956 posts)1. Ten TERAbytes of data EVERY night-----
THAT's a data center I could get behind. Does the world make enough servers for that much data??
usonian
(24,487 posts)3. I'm afraid that all capacity is now directed to AI
So that Grok can undress people.

erronis
(23,403 posts)5. Makes me think of another con artist --- Martin Shrkeli
3Hotdogs
(15,246 posts)2. That's bullshit We don't want to know about novas, supernovas spotted asteroids and shit. We wanna know when the
Romulans are gonna attack.
calimary
(89,545 posts)4. Actually, I DO want to know more about novas, supernovas, and ALL that.
But I DEFINITELY also want to know when the Romulans are gonna attack! And will there be Klingons and Xindi joining with the Romulans? We need to know that, too!
Hey, forewarned REALLY IS fore-armed!
erronis
(23,403 posts)6. Agee with Calimary - knowledge is understanding and wisdom.
usonian
(24,487 posts)7. Romulans? How about Vogons?
I have a towel ready.
Do you?
3Hotdogs
(15,246 posts)8. Yeah, Vogons.
Fuck them. They had years to build a civilization. Do you see one McDonalds or Starbucks on their shithole planet??