MilkyWay@home: Difference between revisions
No edit summary |
update info |
||
| Line 8: | Line 8: | ||
| status = Active | | status = Active | ||
| category = Astrophysics | | category = Astrophysics | ||
| compute = CPU | | compute = CPU, GPU | ||
| dependencies = | | dependencies = | ||
| developer = Heidi Jo Newberg, Travis Desell, Carlos Varela | | developer = Heidi Jo Newberg, Travis Desell, Carlos Varela | ||
| author = | | author = | ||
| sponsor = Rensselaer Polytechnic Institute | | sponsor = Rensselaer Polytechnic Institute | ||
| maintainer = MilkyWay@home team | | maintainer = MilkyWay@home team | ||
| Line 18: | Line 18: | ||
| repository = {{URL|https://github.com/Milkyway-at-home}} | | repository = {{URL|https://github.com/Milkyway-at-home}} | ||
| programming language = C, C++, OpenCL | | programming language = C, C++, OpenCL, CUDA | ||
| operating system = Windows, Linux, macOS | | operating system = Windows, Linux, macOS | ||
| size = ~50 MB | | size = ~50 MB | ||
| Line 31: | Line 31: | ||
| rac = 12400000 | | rac = 12400000 | ||
| credit per day = 730000 | | credit per day = 730000 | ||
| gpu performance = | | gpu performance = | ||
| cpu performance = | | cpu performance = | ||
| website = {{URL|https://milkyway.cs.rpi.edu/milkyway/}} | | website = {{URL|https://milkyway.cs.rpi.edu/milkyway/}} | ||
| license = GNU GPL | | license = GNU GPL v3 | ||
}} | }} | ||
[https://milkyway.cs.rpi.edu/milkyway/ '''''MilkyWay@home'''''] is a '''''[[wikipedia:Volunteer computing|volunteer | [https://milkyway.cs.rpi.edu/milkyway/ '''''MilkyWay@home'''''] is a '''''[[wikipedia:Volunteer computing|volunteer computing]]''''' project operated by [[wikipedia:Rensselaer Polytechnic Institute|Rensselaer Polytechnic Institute]] (RPI). Running on the [[wikipedia:Berkeley Open Infrastructure for Network Computing|BOINC]] platform, it harnesses idle processing power donated by volunteers around the world to study the structure and formation history of the [[wikipedia:Milky Way|Milky Way galaxy]], with particular focus on the [[wikipedia:Galactic halo|galactic stellar halo]], [[wikipedia:Tidal stream|tidal debris streams]], and the distribution of [[wikipedia:Dark matter|dark matter]].<ref>{{cite web |url=https://milkyway.cs.rpi.edu/milkyway/ |title=MilkyWay@home |publisher=Rensselaer Polytechnic Institute |access-date=2026-05-21}}</ref><ref>{{cite journal |last=Newberg |first=Heidi Jo |display-authors=6 |title=MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way |journal=Proceedings of the International Astronomical Union |volume=10 |issue=S298 |pages=98--104 |year=2014 |arxiv=1411.6003}}</ref> | ||
The project is | The project is a collaboration between RPI's Department of Computer Science and its Department of Physics, Applied Physics, and Astronomy, and is funded by the [[wikipedia:National Science Foundation|National Science Foundation]].<ref>{{cite web |url=https://milkyway.cs.rpi.edu/milkyway/information.php |title=Project Information |publisher=MilkyWay@home |access-date=2026-05-21}}</ref> MilkyWay@home was among the earliest BOINC projects to deploy GPU applications at scale, releasing CUDA support for NVIDIA GPUs in June 2009 and subsequently achieving computing rates that rivalled the world's fastest supercomputers.<ref>{{cite conference |last=Desell |first=Travis |display-authors=6 |title=Accelerating the MilkyWay@Home Volunteer Computing Project with GPUs |book-title=Parallel Processing and Applied Mathematics (PPAM 2009) |series=Lecture Notes in Computer Science |volume=6067 |publisher=Springer |year=2010 |doi=10.1007/978-3-642-14390-8_29}}</ref> | ||
== History == | == History == | ||
MilkyWay@home | The roots of MilkyWay@home lie in the individual research of [[wikipedia:Heidi Newberg|Heidi Jo Newberg]], then an associate professor of physics, applied physics, and astronomy at RPI. Her work to map the three-dimensional distribution of stars and matter in the Milky Way using data from the [[wikipedia:Sloan Digital Sky Survey|Sloan Digital Sky Survey]] (SDSS) required computational resources far beyond what a single research group could provide. As Newberg later explained, she faced "a very big computational problem to solve and very little personal computational power or time" available to her.<ref>{{cite news |url=https://news.rpi.edu/luwakkey/2685 |title=PCs Around the World Unite To Map the Milky Way |publisher=Rensselaer Polytechnic Institute |date=2010-02-10 |access-date=2026-05-21}}</ref> | ||
Before bringing the project to BOINC, Newberg worked with Malik Magdon-Ismail, associate professor of computer science, to design a faster and more efficient optimization algorithm. Formal development under the BOINC platform began in July 2006, and the project launched publicly on 1 April 2007.<ref>{{cite news |url=https://www.eurekalert.org/news-releases/554599 |title=PCs around the world unite to map the Milky Way |publisher=EurekAlert! / RPI |date=2010-02-10 |access-date=2026-05-21}}</ref><ref>{{cite web |url=https://milkyway.cs.rpi.edu/milkyway/ |title=MilkyWay@home |publisher=Rensselaer Polytechnic Institute |access-date=2026-05-21}}</ref> | |||
MilkyWay@home | The project's first scientific focus was fitting density models to the [[wikipedia:Sagittarius Stream|Sagittarius tidal stream]], a massive stellar stream produced by the ongoing gravitational disruption of the [[wikipedia:Sagittarius Dwarf Spheroidal Galaxy|Sagittarius Dwarf Spheroidal Galaxy]] as it orbits the Milky Way. Nathan Cole's 2008 paper in the ''Astrophysical Journal'' presented the first major results from this stream-fitting work, applying maximum likelihood methods to SDSS data.<ref>{{cite journal |last=Cole |first=Nathan |display-authors=6 |title=Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails |journal=The Astrophysical Journal |volume=683 |pages=750--766 |year=2008 |url=http://wcl.cs.rpi.edu/papers/cole-apj-2008.pdf}}</ref> | ||
=== GPU computing milestone === | |||
In June 2009, MilkyWay@home released CUDA applications for a broad range of NVIDIA GPUs, following earlier experimental releases in a separate GPU fork of the project. The effect on computing throughput was dramatic. In mid-June 2009 the project was operating at 31.7 teraFLOPS with approximately 24,000 registered users across 149 countries. By 12 January 2010 the average throughput had risen to 1,382 teraFLOPS, a figure that would have placed MilkyWay@home second on the [[wikipedia:TOP500|TOP500]] list of supercomputers at that time, with 44,900 users across 170 countries.<ref>{{cite web |url=https://handwiki.org/wiki/Astronomy:MilkyWay@home |title=MilkyWay@home |publisher=HandWiki |access-date=2026-05-21}}</ref> A press release from RPI confirmed that on 26 January 2010 the project surpassed 1 petaFLOP of sustained computing power, making it at the time the fastest computing project on the BOINC platform and the second fastest public distributed computing program in operation, behind only [[wikipedia:Folding@home|Folding@home]].<ref>{{cite news |url=https://www.sciencedaily.com/releases/2010/02/100210124823.htm |title=Home computers around the world unite to map the Milky Way |publisher=ScienceDaily |date=2010-02-10 |access-date=2026-05-21}}</ref> | |||
At its peak, shortly after GPU code was released, MilkyWay@home delivered approximately 2 petaFLOPS of computing power. By 2012 the project was running at around 0.5 petaFLOPS, which still represented processing power equivalent to the 45th fastest supercomputer in the world at that time.<ref>{{cite journal |last=Newberg |first=Heidi Jo |display-authors=6 |title=MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way |journal=Proceedings of the International Astronomical Union |volume=10 |issue=S298 |pages=98--104 |year=2014 |arxiv=1411.6003}}</ref> | |||
An OpenCL application for AMD Radeon GPUs was also made available, allowing volunteers with AMD hardware to contribute at similarly high throughput rates.<ref>{{cite web |url=https://en.wikipedia.org/wiki/MilkyWay@home |title=MilkyWay@home |publisher=Wikipedia |access-date=2026-05-21}}</ref> | |||
== Scientific objectives == | == Scientific objectives == | ||
The | The central scientific mission of MilkyWay@home is to build an accurate, three-dimensional model of the Milky Way's stellar halo and to constrain the distribution of dark matter within it. The strategy relies on analyzing the orbits and disruption patterns of dwarf satellite galaxies, whose tidal debris encodes information about the gravitational potential -- and thus the dark matter content -- of the Milky Way.<ref>{{cite journal |last=Newberg |first=Heidi Jo |display-authors=6 |title=MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way |journal=Proceedings of the International Astronomical Union |year=2014 |arxiv=1411.6003}}</ref> | ||
The project | The project runs two complementary types of applications. The first fits the spatial density profile of stellar tidal streams using [[wikipedia:Photometric parallax method|statistical photometric parallax]] applied to main sequence turnoff (MSTO) stars from the SDSS. Each volunteer's computer evaluates the likelihood of one set of density model parameters given the observed positions and magnitudes of turnoff stars, contributing one step in a global parameter optimization. The second application, the N-body subproject, simulates full dwarf galaxies being disrupted within a model of the Milky Way's gravitational field, iterating initial conditions until the simulated tidal debris matches observed stellar structures.<ref>{{cite journal |last=Newberg |first=Heidi Jo |display-authors=6 |title=MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way |journal=Proceedings of the International Astronomical Union |year=2014 |arxiv=1411.6003}}</ref> | ||
Formally, the stream fitting procedure seeks to maximize the log-likelihood: | |||
== | :<math>\ln \mathcal{L} = \sum_{i=1}^{N} \ln \left[ \frac{\Phi \cdot f_s(\mathbf{x}_i) + (1-\Phi) \cdot f_b(\mathbf{x}_i)}{C} \right]</math> | ||
The N-body | where <math>\Phi</math> is the stream fraction, <math>f_s</math> and <math>f_b</math> are the stream and background density functions, and the sum runs over all <math>N</math> observed turnoff stars in an SDSS stripe.<ref>{{cite journal |last=Cole |first=Nathan |display-authors=6 |title=Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails |journal=The Astrophysical Journal |volume=683 |pages=750--766 |year=2008 |url=http://wcl.cs.rpi.edu/papers/cole-apj-2008.pdf}}</ref> Goodness-of-fit for the N-body application is measured using an Earth-Mover Distance method applied to stellar densities along the stream.<ref>{{cite journal |last=Newberg |first=Heidi Jo |display-authors=6 |title=MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way |journal=Proceedings of the International Astronomical Union |year=2014 |arxiv=1411.6003}}</ref> | ||
Research areas addressed by the project include: | |||
The | * The three-dimensional density profile of the Milky Way stellar halo | ||
* The [[wikipedia:Sagittarius Stream|Sagittarius tidal stream]] and its bifurcated components | |||
* The Virgo Overdensity and other halo substructures | |||
* The Orphan-Chenab Stream and its progenitor dwarf galaxy | |||
* Dwarf galaxy progenitor masses and dark matter fractions | |||
* The gravitational potential of the Milky Way and implied dark matter halo shape | |||
== Methods == | == Methods == | ||
[[File:Our best map of the Milky Way so far (the-milky-way-galaxy).jpg|thumb|350x350px|An artist's rendering of the Milky Way galaxy, whose structure MilkyWay@home aims to map and model]] | |||
=== Stream density fitting === | |||
MilkyWay@home uses SDSS photometric data to measure the spatial density of F-type main sequence turnoff stars in the galactic halo. The sky is divided into wedges of approximately 2.5 degrees width, and for each wedge the volunteer application evaluates a density model consisting of a smooth spheroid background component plus one or more tidal stream components. Self-optimizing evolutionary algorithms, including differential evolution and particle swarm optimization methods, are used to find the best-fit parameters across the high-dimensional parameter space.<ref>{{cite journal |last=Weiss |first=Jake |display-authors=6 |title=Fitting the Density Substructure of the Stellar Halo with MilkyWay@home |journal=The Astrophysical Journal Supplement Series |year=2018 |url=https://milkyway.cs.rpi.edu/milkyway/publications/Weiss_2018_ApJS_238_17.pdf}}</ref><ref>{{cite conference |last=Desell |first=Travis |display-authors=6 |title=Robust Asynchronous Optimization for Volunteer Computing Grids |book-title=IEEE e-Science 2009 |year=2009 |url=http://wcl.cs.rpi.edu/papers/escience2009.pdf}}</ref> | |||
=== N-body simulations === | |||
The N-body subproject creates simulated dwarf galaxies and evolves them within a model of the Milky Way's gravitational potential. The simulation adjusts the initial conditions of the dwarf galaxy -- its mass, concentration, orbital parameters, and dark matter fraction -- until the resulting tidal debris pattern matches observed stellar stream structures. Because a single N-body simulation can require hours of CPU time, distributing thousands of simulations simultaneously across volunteer computers is essential for exploring the parameter space efficiently.<ref>{{cite journal |last=Shelton |first=Siddhartha |display-authors=6 |title=An Algorithm for Reconstructing the Orphan Stream Progenitor with MilkyWay@home Volunteer Computing |journal=The Astrophysical Journal |year=2021 |url=https://milkyway.cs.rpi.edu/milkyway/publications/Shelton_2021.pdf}}</ref> | |||
=== Optimization algorithms === | |||
Because volunteer computing platforms are asynchronous and heterogeneous -- work units are completed on wildly different hardware at unpredictable times -- MilkyWay@home required the development of specially adapted optimization methods. The team published work on robust asynchronous optimization algorithms tailored for this environment, and on validating evolutionary algorithms in the context of volunteer grids.<ref>{{cite conference |last=Desell |first=Travis |display-authors=6 |title=Validating Evolutionary Algorithms on Volunteer Computing Grids |book-title=DAIS 2010 |year=2010 |url=https://milkyway.cs.rpi.edu/milkyway/publications/desell_dais_2010.pdf}}</ref><ref>{{cite conference |last=Desell |first=Travis |display-authors=6 |title=An Analysis of Massively Distributed Evolutionary Algorithms |book-title=IEEE CEC 2010 |year=2010}}</ref> | |||
== Applications == | == Applications == | ||
[[File:NvidiaTesla.jpg|thumb|350x350px|An NVIDIA Tesla GPU of the kind used by MilkyWay@home volunteers. GPU computing transformed the project's throughput from tens of teraflops to well over a petaflop.]] | |||
MilkyWay@home applications are distributed through the BOINC client and support Windows, Linux, and macOS. The project has historically compiled its code for sixteen different platforms to support the heterogeneous hardware of its volunteer base.<ref>{{cite journal |last=Newberg |first=Heidi Jo |display-authors=6 |title=MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way |journal=Proceedings of the International Astronomical Union |year=2014 |arxiv=1411.6003}}</ref> | |||
Supported application types include: | |||
* CPU applications | * CPU applications (32-bit and 64-bit), available since 2008 | ||
* NVIDIA GPU applications using CUDA | * NVIDIA GPU applications using CUDA, released June 2009 | ||
* AMD GPU applications using OpenCL | * AMD GPU applications using OpenCL | ||
* Multi-threaded N-body | * Multi-threaded N-body simulation applications | ||
Work units originally required 2 to 4 hours of computation on a modern CPU, with a three-day deadline. By early 2010, the project was routinely issuing much larger units requiring 15 to 20 hours of CPU time, valid for approximately one week. By 2018, GPU-based tasks had become so optimized that many could be completed in under a minute on a high-end graphics card.<ref>{{cite web |url=https://en.wikipedia.org/wiki/MilkyWay@home |title=MilkyWay@home |publisher=Wikipedia |access-date=2026-05-21}}</ref> | |||
The | The project does not include a traditional graphical screensaver. Instead, animations of the best N-body simulations are shared via YouTube.<ref>{{cite web |url=https://en.wikipedia.org/wiki/MilkyWay@home |title=MilkyWay@home |publisher=Wikipedia |access-date=2026-05-21}}</ref> | ||
== | MilkyWay@home is a whitelisted [[wikipedia:Gridcoin|Gridcoin]] project and is reported to be the second-largest generator of Gridcoins among BOINC projects.<ref>{{cite web |url=https://en.wikipedia.org/wiki/MilkyWay@home |title=MilkyWay@home |publisher=Wikipedia |access-date=2026-05-21}}</ref> | ||
The project team has included: | == Project team and funding == | ||
[[File:SagDwarfGalaxy.jpg|thumb|350x350px|The [[wikipedia:Sagittarius Dwarf Spheroidal Galaxy|Sagittarius Dwarf Spheroidal Galaxy]] (center), the primary source of the tidal stream first studied by MilkyWay@home, imaged in the infrared by the 2MASS survey]] | |||
MilkyWay@home is a collaboration between RPI's Department of Computer Science and Department of Physics, Applied Physics, and Astronomy. The project team has included: | |||
* Heidi Jo Newberg | * Heidi Jo Newberg (astrophysics lead) | ||
* Travis Desell (volunteer computing and GPU optimization) | |||
* Malik Magdon-Ismail (optimization algorithms) | |||
* Carlos Varela (distributed computing infrastructure) | |||
* Boleslaw K. Szymanski (distributed systems) | |||
* Matthew Newby | |||
* Nathan Cole | |||
* Kevin Roux | * Kevin Roux | ||
* Hiroka Warren | * Hiroka Warren | ||
The project is | The project is supported by the [[wikipedia:National Science Foundation|National Science Foundation]] under Grant Numbers 0612213, 0607618, 0448407, 1009670, 1615688, and 1908653.<ref>{{cite web |url=https://milkyway.cs.rpi.edu/milkyway/information.php |title=Project Information |publisher=MilkyWay@home |access-date=2026-05-21}}</ref> Individual grants include: | ||
# [https://www.nsf.gov/awardsearch/showAward?AWD_ID=1908653 NSF Grant #1908653] | |||
# [https://www.nsf.gov/awardsearch/showAward?AWD_ID=1615688 Charting the Structure of the Milky Way Stellar Halo and Disk], NSF AST Grant #1615688, 09/15/2016 -- 08/31/2019, Principal Investigator: Heidi Jo Newberg | |||
# [https://www.nsf.gov/awardsearch/showAward?AWD_ID=1615688 Charting the Structure of the Milky Way Stellar Halo and Disk], NSF AST Grant #1615688, 09/15/2016 - 08/31/2019, Principal Investigator: Heidi Jo Newberg | |||
# [http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=1009670 Stars and Dark Matter in the Halo of the Milky Way], NSF AST Grant #1009670, started 09/15/2010 | # [http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=1009670 Stars and Dark Matter in the Halo of the Milky Way], NSF AST Grant #1009670, started 09/15/2010 | ||
# [http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=0612213 Data-Driven Discovery of the Milky Way Origin and Evolution from the Sloan Digital Sky Survey], NSF IIS Grant #0612213 | # [http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=0612213 Data-Driven Discovery of the Milky Way Origin and Evolution from the Sloan Digital Sky Survey], NSF IIS Grant #0612213 | ||
# [http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=0448407 Middleware and Programming Technology for Grid Computing], NSF CAREER Grant #0448407 | # [http://www.nsf.gov/awardsearch/showAward.do?AwardNumber=0448407 Middleware and Programming Technology for Grid Computing], NSF CAREER Grant #0448407 | ||
== BOINC statistics == | == BOINC statistics == | ||
As of May 2026, MilkyWay@home remains one of the largest astronomy-focused BOINC | As of May 2026, MilkyWay@home remains one of the largest and most active astronomy-focused projects on the BOINC platform, with over 257,000 total registered users across more than 1.5 million total hosts. At its peak throughput following the GPU release, the project delivered approximately 2 petaFLOPS of sustained computing power. The project has maintained a strong and active GPU cruncher community due to the efficiency of its OpenCL applications and characteristically high credit generation rates.<ref>{{cite web |url=https://milkyway.cs.rpi.edu/milkyway/server_status.php |title=Server Status |publisher=MilkyWay@home |access-date=2026-05-21}}</ref> | ||
== Scientific publications == | == Scientific publications == | ||
=== | === Astrophysics journal papers === | ||
# Eric J. Mendelsohn. [https://milkyway.cs.rpi.edu/milkyway/publications/Eric.M_thesis.pdf Using MilkyWay@home to Measure the Mass of the Orphan-Chenab Stream Progenitor Dwarf Galaxy]. PhD thesis. Rensselaer Polytechnic Institute, 2022. | # Eric J. Mendelsohn. [https://milkyway.cs.rpi.edu/milkyway/publications/Eric.M_thesis.pdf Using MilkyWay@home to Measure the Mass of the Orphan-Chenab Stream Progenitor Dwarf Galaxy]. PhD thesis. Rensselaer Polytechnic Institute, 2022. | ||
# Eric J. Mendelsohn, Heidi Jo Newberg, Siddhartha Shelton, Lawrence M. Widrow, Jeffery M. Thompson, Carl J. Grillmair. [https://milkyway.cs.rpi.edu/milkyway/publications/Mendelsohn_2022.pdf Estimate of the Mass and Radial Profile of the Orphan-Chenab Stream's Dwarf-galaxy Progenitor Using MilkyWay@home]. ''The Astrophysical Journal'', 2022. | # Eric J. Mendelsohn, Heidi Jo Newberg, Siddhartha Shelton, Lawrence M. Widrow, Jeffery M. Thompson, Carl J. Grillmair. [https://milkyway.cs.rpi.edu/milkyway/publications/Mendelsohn_2022.pdf Estimate of the Mass and Radial Profile of the Orphan-Chenab Stream's Dwarf-galaxy Progenitor Using MilkyWay@home]. ''The Astrophysical Journal'', 2022. doi:10.3847/1538-4357/ac498a | ||
# Siddhartha Shelton et al. [https://milkyway.cs.rpi.edu/milkyway/publications/Shelton_2021.pdf An Algorithm for Reconstructing the Orphan Stream Progenitor with MilkyWay@home Volunteer Computing]. ''The Astrophysical Journal'', 2021. | # Siddhartha Shelton et al. [https://milkyway.cs.rpi.edu/milkyway/publications/Shelton_2021.pdf An Algorithm for Reconstructing the Orphan Stream Progenitor with MilkyWay@home Volunteer Computing]. ''The Astrophysical Journal'', 2021. | ||
# Heidi Jo Newberg et al. [https://milkyway.cs.rpi.edu/milkyway/publications/Newberg_2020.pdf Streams and the Milky Way Dark Matter Halo]. International Astronomical Union, 2020. | # Heidi Jo Newberg et al. [https://milkyway.cs.rpi.edu/milkyway/publications/Newberg_2020.pdf Streams and the Milky Way Dark Matter Halo]. International Astronomical Union, 2020. | ||
# Jake Weiss, Heidi Jo Newberg, Travis Desell. [https://milkyway.cs.rpi.edu/milkyway/publications/Weiss_2018.pdf A Tangle of Stellar Streams in the North Galactic Cap]. ''The Astrophysical Journal'', 2018. | # Jake Weiss, Heidi Jo Newberg, Travis Desell. [https://milkyway.cs.rpi.edu/milkyway/publications/Weiss_2018.pdf A Tangle of Stellar Streams in the North Galactic Cap]. ''The Astrophysical Journal'', 2018. | ||
# Jake Weiss, Heidi Jo Newberg, Matthew Newby, Travis Desell. [https://milkyway.cs.rpi.edu/milkyway/publications/Weiss_2018_ApJS_238_17.pdf Fitting the Density Substructure of the Stellar Halo with MilkyWay@home]. ''The Astrophysical Journal'', 2018. | # Jake Weiss, Heidi Jo Newberg, Matthew Newby, Travis Desell. [https://milkyway.cs.rpi.edu/milkyway/publications/Weiss_2018_ApJS_238_17.pdf Fitting the Density Substructure of the Stellar Halo with MilkyWay@home]. ''The Astrophysical Journal Supplement Series'', 2018. | ||
# Heidi Jo Newberg, Matthew Newby, Travis Desell, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela. [http://arxiv.org/pdf/1411.6003v1.pdf MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way]. Proceedings of the International Astronomical Union, 2014. | # Heidi Jo Newberg, Matthew Newby, Travis Desell, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela. [http://arxiv.org/pdf/1411.6003v1.pdf MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way]. ''Proceedings of the International Astronomical Union'', 2014. | ||
# Matthew Newby | # Matthew T. Newby. [https://dspace.rpi.edu/handle/20.500.13015/971 The Sagittarius Tidal Stream and the Shape of the Galactic Stellar Halo]. PhD thesis. Rensselaer Polytechnic Institute, 2013. | ||
# Matthew Newby, Nathan Cole, Heidi Newberg, Travis Desell, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela, Benjamin Willett, Brian Yanny. [http://iopscience.iop.org/1538-3881/145/6/163/pdf/1538-3881_145_6_163.pdf Spatial Characterization of the Sagittarius Dwarf Galaxy Tidal Tails]. ''Astronomical Journal'', 2013. | |||
# Benjamin Arthur Willett. Simultaneous Orbit Fitting of Stellar Streams: Constraining the Galactic Dark Matter Halo. PhD thesis. Rensselaer Polytechnic Institute, 2010. | |||
# Nathan Cole et al. [http://wcl.cs.rpi.edu/papers/cole-apj-2008.pdf Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails]. ''Astrophysical Journal'', 2008. | # Nathan Cole et al. [http://wcl.cs.rpi.edu/papers/cole-apj-2008.pdf Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails]. ''Astrophysical Journal'', 2008. | ||
=== Computer science and volunteer computing papers === | === Computer science and volunteer computing papers === | ||
# Travis Desell, Anthony Waters, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela, Matthew Newby, Heidi Newberg, Andreas Przystawik, Dave Anderson. [http://wcl.cs.rpi.edu/papers/ppam2009.pdf Accelerating the MilkyWay@Home Volunteer Computing Project with GPUs]. PPAM 2009. Published in ''Lecture Notes in Computer Science'', vol. 6067, Springer, 2010. doi:10.1007/978-3-642-14390-8_29 | |||
# Travis Desell et al. [http://wcl.cs.rpi.edu/papers/escience2009.pdf Robust Asynchronous Optimization for Volunteer Computing Grids]. IEEE e-Science 2009. | # Travis Desell et al. [http://wcl.cs.rpi.edu/papers/escience2009.pdf Robust Asynchronous Optimization for Volunteer Computing Grids]. IEEE e-Science 2009. | ||
# Travis Desell et al. [https://milkyway.cs.rpi.edu/milkyway/publications/desell_dais_2010.pdf Validating Evolutionary Algorithms on Volunteer Computing Grids]. DAIS 2010. | # Travis Desell et al. [https://milkyway.cs.rpi.edu/milkyway/publications/desell_dais_2010.pdf Validating Evolutionary Algorithms on Volunteer Computing Grids]. DAIS 2010. | ||
# Travis Desell et al. [http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5586073&tag=1 An Analysis of Massively Distributed Evolutionary Algorithms]. IEEE CEC 2010. | # Travis Desell et al. [http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5586073&tag=1 An Analysis of Massively Distributed Evolutionary Algorithms]. IEEE CEC 2010. | ||
# Nathan Cole et al. [https://milkyway.cs.rpi.edu/milkyway/publications/cole2009.pdf A Study of the Sagittarius Tidal Stream Using Maximum Likelihood]. ADASS XVIII, 2009. | # Nathan Cole et al. [https://milkyway.cs.rpi.edu/milkyway/publications/cole2009.pdf A Study of the Sagittarius Tidal Stream Using Maximum Likelihood]. ADASS XVIII, 2009. | ||
# Carlos Varela. [https://milkyway.cs.rpi.edu/milkyway/publications/ Enabling Synchronous Computation on Volunteer Computing Grids]. The 4th Pan-Galactic BOINC Workshop, 2008. | |||
== See also == | == See also == | ||
| Line 145: | Line 169: | ||
* [[wikipedia:SETI@home|SETI@home]] | * [[wikipedia:SETI@home|SETI@home]] | ||
* [[wikipedia:Einstein@Home|Einstein@Home]] | * [[wikipedia:Einstein@Home|Einstein@Home]] | ||
* [[wikipedia: | * [[wikipedia:Sagittarius Stream|Sagittarius Stream]] | ||
* [[wikipedia:Sagittarius Dwarf Spheroidal Galaxy|Sagittarius Dwarf Spheroidal Galaxy]] | |||
* [[wikipedia:Dark matter|Dark matter]] | * [[wikipedia:Dark matter|Dark matter]] | ||
* [[wikipedia:Galactic halo|Galactic halo]] | |||
* [[wikipedia:Sloan Digital Sky Survey|Sloan Digital Sky Survey]] | |||
* [[wikipedia:Gridcoin|Gridcoin]] | |||
== External links == | == External links == | ||
| Line 153: | Line 181: | ||
* [https://milkyway.cs.rpi.edu/milkyway/forum_index.php Project forums] | * [https://milkyway.cs.rpi.edu/milkyway/forum_index.php Project forums] | ||
* [https://milkyway.cs.rpi.edu/milkyway/server_status.php Server status] | * [https://milkyway.cs.rpi.edu/milkyway/server_status.php Server status] | ||
* [https://milkyway.cs.rpi.edu/milkyway/information.php Project information and publications] | |||
* [https://github.com/Milkyway-at-home GitHub repository] | * [https://github.com/Milkyway-at-home GitHub repository] | ||
* [https://boinc.berkeley.edu/ BOINC] | * [https://boinc.berkeley.edu/ BOINC] | ||
| Line 168: | Line 197: | ||
[[Category:Rensselaer Polytechnic Institute]] | [[Category:Rensselaer Polytechnic Institute]] | ||
[[Category:2007 software]] | [[Category:2007 software]] | ||
[[Category:GPU computing]] | |||
[[Category:Gridcoin]] | |||
Latest revision as of 17:34, 8 June 2026
MilkyWay@home is a volunteer computing project operated by Rensselaer Polytechnic Institute (RPI). Running on the BOINC platform, it harnesses idle processing power donated by volunteers around the world to study the structure and formation history of the Milky Way galaxy, with particular focus on the galactic stellar halo, tidal debris streams, and the distribution of dark matter.[1][2]
The project is a collaboration between RPI's Department of Computer Science and its Department of Physics, Applied Physics, and Astronomy, and is funded by the National Science Foundation.[3] MilkyWay@home was among the earliest BOINC projects to deploy GPU applications at scale, releasing CUDA support for NVIDIA GPUs in June 2009 and subsequently achieving computing rates that rivalled the world's fastest supercomputers.[4]
History
The roots of MilkyWay@home lie in the individual research of Heidi Jo Newberg, then an associate professor of physics, applied physics, and astronomy at RPI. Her work to map the three-dimensional distribution of stars and matter in the Milky Way using data from the Sloan Digital Sky Survey (SDSS) required computational resources far beyond what a single research group could provide. As Newberg later explained, she faced "a very big computational problem to solve and very little personal computational power or time" available to her.[5]
Before bringing the project to BOINC, Newberg worked with Malik Magdon-Ismail, associate professor of computer science, to design a faster and more efficient optimization algorithm. Formal development under the BOINC platform began in July 2006, and the project launched publicly on 1 April 2007.[6][7]
The project's first scientific focus was fitting density models to the Sagittarius tidal stream, a massive stellar stream produced by the ongoing gravitational disruption of the Sagittarius Dwarf Spheroidal Galaxy as it orbits the Milky Way. Nathan Cole's 2008 paper in the Astrophysical Journal presented the first major results from this stream-fitting work, applying maximum likelihood methods to SDSS data.[8]
GPU computing milestone
In June 2009, MilkyWay@home released CUDA applications for a broad range of NVIDIA GPUs, following earlier experimental releases in a separate GPU fork of the project. The effect on computing throughput was dramatic. In mid-June 2009 the project was operating at 31.7 teraFLOPS with approximately 24,000 registered users across 149 countries. By 12 January 2010 the average throughput had risen to 1,382 teraFLOPS, a figure that would have placed MilkyWay@home second on the TOP500 list of supercomputers at that time, with 44,900 users across 170 countries.[9] A press release from RPI confirmed that on 26 January 2010 the project surpassed 1 petaFLOP of sustained computing power, making it at the time the fastest computing project on the BOINC platform and the second fastest public distributed computing program in operation, behind only Folding@home.[10]
At its peak, shortly after GPU code was released, MilkyWay@home delivered approximately 2 petaFLOPS of computing power. By 2012 the project was running at around 0.5 petaFLOPS, which still represented processing power equivalent to the 45th fastest supercomputer in the world at that time.[11]
An OpenCL application for AMD Radeon GPUs was also made available, allowing volunteers with AMD hardware to contribute at similarly high throughput rates.[12]
Scientific objectives
The central scientific mission of MilkyWay@home is to build an accurate, three-dimensional model of the Milky Way's stellar halo and to constrain the distribution of dark matter within it. The strategy relies on analyzing the orbits and disruption patterns of dwarf satellite galaxies, whose tidal debris encodes information about the gravitational potential -- and thus the dark matter content -- of the Milky Way.[13]
The project runs two complementary types of applications. The first fits the spatial density profile of stellar tidal streams using statistical photometric parallax applied to main sequence turnoff (MSTO) stars from the SDSS. Each volunteer's computer evaluates the likelihood of one set of density model parameters given the observed positions and magnitudes of turnoff stars, contributing one step in a global parameter optimization. The second application, the N-body subproject, simulates full dwarf galaxies being disrupted within a model of the Milky Way's gravitational field, iterating initial conditions until the simulated tidal debris matches observed stellar structures.[14]
Formally, the stream fitting procedure seeks to maximize the log-likelihood:
where is the stream fraction, and are the stream and background density functions, and the sum runs over all observed turnoff stars in an SDSS stripe.[15] Goodness-of-fit for the N-body application is measured using an Earth-Mover Distance method applied to stellar densities along the stream.[16]
Research areas addressed by the project include:
- The three-dimensional density profile of the Milky Way stellar halo
- The Sagittarius tidal stream and its bifurcated components
- The Virgo Overdensity and other halo substructures
- The Orphan-Chenab Stream and its progenitor dwarf galaxy
- Dwarf galaxy progenitor masses and dark matter fractions
- The gravitational potential of the Milky Way and implied dark matter halo shape
Methods

Stream density fitting
MilkyWay@home uses SDSS photometric data to measure the spatial density of F-type main sequence turnoff stars in the galactic halo. The sky is divided into wedges of approximately 2.5 degrees width, and for each wedge the volunteer application evaluates a density model consisting of a smooth spheroid background component plus one or more tidal stream components. Self-optimizing evolutionary algorithms, including differential evolution and particle swarm optimization methods, are used to find the best-fit parameters across the high-dimensional parameter space.[17][18]
N-body simulations
The N-body subproject creates simulated dwarf galaxies and evolves them within a model of the Milky Way's gravitational potential. The simulation adjusts the initial conditions of the dwarf galaxy -- its mass, concentration, orbital parameters, and dark matter fraction -- until the resulting tidal debris pattern matches observed stellar stream structures. Because a single N-body simulation can require hours of CPU time, distributing thousands of simulations simultaneously across volunteer computers is essential for exploring the parameter space efficiently.[19]
Optimization algorithms
Because volunteer computing platforms are asynchronous and heterogeneous -- work units are completed on wildly different hardware at unpredictable times -- MilkyWay@home required the development of specially adapted optimization methods. The team published work on robust asynchronous optimization algorithms tailored for this environment, and on validating evolutionary algorithms in the context of volunteer grids.[20][21]
Applications

MilkyWay@home applications are distributed through the BOINC client and support Windows, Linux, and macOS. The project has historically compiled its code for sixteen different platforms to support the heterogeneous hardware of its volunteer base.[22]
Supported application types include:
- CPU applications (32-bit and 64-bit), available since 2008
- NVIDIA GPU applications using CUDA, released June 2009
- AMD GPU applications using OpenCL
- Multi-threaded N-body simulation applications
Work units originally required 2 to 4 hours of computation on a modern CPU, with a three-day deadline. By early 2010, the project was routinely issuing much larger units requiring 15 to 20 hours of CPU time, valid for approximately one week. By 2018, GPU-based tasks had become so optimized that many could be completed in under a minute on a high-end graphics card.[23]
The project does not include a traditional graphical screensaver. Instead, animations of the best N-body simulations are shared via YouTube.[24]
MilkyWay@home is a whitelisted Gridcoin project and is reported to be the second-largest generator of Gridcoins among BOINC projects.[25]
Project team and funding

MilkyWay@home is a collaboration between RPI's Department of Computer Science and Department of Physics, Applied Physics, and Astronomy. The project team has included:
- Heidi Jo Newberg (astrophysics lead)
- Travis Desell (volunteer computing and GPU optimization)
- Malik Magdon-Ismail (optimization algorithms)
- Carlos Varela (distributed computing infrastructure)
- Boleslaw K. Szymanski (distributed systems)
- Matthew Newby
- Nathan Cole
- Kevin Roux
- Hiroka Warren
The project is supported by the National Science Foundation under Grant Numbers 0612213, 0607618, 0448407, 1009670, 1615688, and 1908653.[26] Individual grants include:
- NSF Grant #1908653
- Charting the Structure of the Milky Way Stellar Halo and Disk, NSF AST Grant #1615688, 09/15/2016 -- 08/31/2019, Principal Investigator: Heidi Jo Newberg
- Stars and Dark Matter in the Halo of the Milky Way, NSF AST Grant #1009670, started 09/15/2010
- Data-Driven Discovery of the Milky Way Origin and Evolution from the Sloan Digital Sky Survey, NSF IIS Grant #0612213
- Middleware and Programming Technology for Grid Computing, NSF CAREER Grant #0448407
BOINC statistics
As of May 2026, MilkyWay@home remains one of the largest and most active astronomy-focused projects on the BOINC platform, with over 257,000 total registered users across more than 1.5 million total hosts. At its peak throughput following the GPU release, the project delivered approximately 2 petaFLOPS of sustained computing power. The project has maintained a strong and active GPU cruncher community due to the efficiency of its OpenCL applications and characteristically high credit generation rates.[27]
Scientific publications
Astrophysics journal papers
- Eric J. Mendelsohn. Using MilkyWay@home to Measure the Mass of the Orphan-Chenab Stream Progenitor Dwarf Galaxy. PhD thesis. Rensselaer Polytechnic Institute, 2022.
- Eric J. Mendelsohn, Heidi Jo Newberg, Siddhartha Shelton, Lawrence M. Widrow, Jeffery M. Thompson, Carl J. Grillmair. Estimate of the Mass and Radial Profile of the Orphan-Chenab Stream's Dwarf-galaxy Progenitor Using MilkyWay@home. The Astrophysical Journal, 2022. doi:10.3847/1538-4357/ac498a
- Siddhartha Shelton et al. An Algorithm for Reconstructing the Orphan Stream Progenitor with MilkyWay@home Volunteer Computing. The Astrophysical Journal, 2021.
- Heidi Jo Newberg et al. Streams and the Milky Way Dark Matter Halo. International Astronomical Union, 2020.
- Jake Weiss, Heidi Jo Newberg, Travis Desell. A Tangle of Stellar Streams in the North Galactic Cap. The Astrophysical Journal, 2018.
- Jake Weiss, Heidi Jo Newberg, Matthew Newby, Travis Desell. Fitting the Density Substructure of the Stellar Halo with MilkyWay@home. The Astrophysical Journal Supplement Series, 2018.
- Heidi Jo Newberg, Matthew Newby, Travis Desell, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela. MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union, 2014.
- Matthew T. Newby. The Sagittarius Tidal Stream and the Shape of the Galactic Stellar Halo. PhD thesis. Rensselaer Polytechnic Institute, 2013.
- Matthew Newby, Nathan Cole, Heidi Newberg, Travis Desell, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela, Benjamin Willett, Brian Yanny. Spatial Characterization of the Sagittarius Dwarf Galaxy Tidal Tails. Astronomical Journal, 2013.
- Benjamin Arthur Willett. Simultaneous Orbit Fitting of Stellar Streams: Constraining the Galactic Dark Matter Halo. PhD thesis. Rensselaer Polytechnic Institute, 2010.
- Nathan Cole et al. Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails. Astrophysical Journal, 2008.
Computer science and volunteer computing papers
- Travis Desell, Anthony Waters, Malik Magdon-Ismail, Boleslaw Szymanski, Carlos Varela, Matthew Newby, Heidi Newberg, Andreas Przystawik, Dave Anderson. Accelerating the MilkyWay@Home Volunteer Computing Project with GPUs. PPAM 2009. Published in Lecture Notes in Computer Science, vol. 6067, Springer, 2010. doi:10.1007/978-3-642-14390-8_29
- Travis Desell et al. Robust Asynchronous Optimization for Volunteer Computing Grids. IEEE e-Science 2009.
- Travis Desell et al. Validating Evolutionary Algorithms on Volunteer Computing Grids. DAIS 2010.
- Travis Desell et al. An Analysis of Massively Distributed Evolutionary Algorithms. IEEE CEC 2010.
- Nathan Cole et al. A Study of the Sagittarius Tidal Stream Using Maximum Likelihood. ADASS XVIII, 2009.
- Carlos Varela. Enabling Synchronous Computation on Volunteer Computing Grids. The 4th Pan-Galactic BOINC Workshop, 2008.
See also
- BOINC
- Volunteer computing
- SETI@home
- Einstein@Home
- Sagittarius Stream
- Sagittarius Dwarf Spheroidal Galaxy
- Dark matter
- Galactic halo
- Sloan Digital Sky Survey
- Gridcoin
External links
- Official website
- Project forums
- Server status
- Project information and publications
- GitHub repository
- BOINC
References
- ↑ MilkyWay@home. Rensselaer Polytechnic Institute. Retrieved 2026-05-21.
- ↑ Newberg, Heidi Jo.(2014).MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union. pp. 98--104.
- ↑ Project Information. MilkyWay@home. Retrieved 2026-05-21.
- ↑ (2010})."Accelerating the MilkyWay@Home Volunteer Computing Project with GPUs".DOI: 10.1007/978-3-642-14390-8_29.
- ↑ Template:Cite news
- ↑ Template:Cite news
- ↑ MilkyWay@home. Rensselaer Polytechnic Institute. Retrieved 2026-05-21.
- ↑ Cole, Nathan.(2008).Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails. The Astrophysical Journal. pp. 750--766.
- ↑ MilkyWay@home. HandWiki. Retrieved 2026-05-21.
- ↑ Template:Cite news
- ↑ Newberg, Heidi Jo.(2014).MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union. pp. 98--104.
- ↑ MilkyWay@home. Wikipedia. Retrieved 2026-05-21.
- ↑ Newberg, Heidi Jo.(2014).MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union.
- ↑ Newberg, Heidi Jo.(2014).MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union.
- ↑ Cole, Nathan.(2008).Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails. The Astrophysical Journal. pp. 750--766.
- ↑ Newberg, Heidi Jo.(2014).MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union.
- ↑ Weiss, Jake.(2018).Fitting the Density Substructure of the Stellar Halo with MilkyWay@home. The Astrophysical Journal Supplement Series.
- ↑ (2009})."Robust Asynchronous Optimization for Volunteer Computing Grids".link.
- ↑ Shelton, Siddhartha.(2021).An Algorithm for Reconstructing the Orphan Stream Progenitor with MilkyWay@home Volunteer Computing. The Astrophysical Journal.
- ↑ (2010})."Validating Evolutionary Algorithms on Volunteer Computing Grids".link.
- ↑ (2010})."An Analysis of Massively Distributed Evolutionary Algorithms".
- ↑ Newberg, Heidi Jo.(2014).MilkyWay@home: Harnessing Volunteer Computers to Constrain Dark Matter in the Milky Way. Proceedings of the International Astronomical Union.
- ↑ MilkyWay@home. Wikipedia. Retrieved 2026-05-21.
- ↑ MilkyWay@home. Wikipedia. Retrieved 2026-05-21.
- ↑ MilkyWay@home. Wikipedia. Retrieved 2026-05-21.
- ↑ Project Information. MilkyWay@home. Retrieved 2026-05-21.
- ↑ Server Status. MilkyWay@home. Retrieved 2026-05-21.

