I recently had a very interesting, but sobering experience - giving a TedX talk in Mountain View, at a conference sponsored by Intuit (yes, the TurboTax people; they also make accounting software). The audience was mostly Intuit employees, from diverse backgrounds - sofware engineers, accountants, HR people, PR people, etc. There were 15 speakers (+4 videos of previously presented TedX talks) - me, a geologist, and 13 non-scientists. Most were excellent, and it was interesting to watch the diverse presentation styles. I was upstaged by the following speaker - a 10 year old. She was the world champion in Brazilian ju-jitsu, and spoke eloquently about being a warrior. Other presenters included a magician, an ex-CNN anchor speaking on money management, a pianist, and a capoeira group.
In discussing my talk, the organizers emphasized a couple of things: tell a good story, and engage with the audience. These are two basics, but are way too rarely found in scientific presentations. Our material is important and interesting to us, so we automatically assume that the audience will feel the same way. This is not true! I'm as guilty as any other scientist here, and really appreciated being reminded of these basics, both by the organizers beforehand, and while listening to the other speakers.
Over the past few years, my kids have been studying 5-paragraph essays. I learned this too: an introduction with hypothesis, 3 arguments (1 paragraph each) and a concluding paragraph. My kids learned it a bit differently. The first paragraph must start with a 'grabber:' a sentence to grab the readers attention. Likewise, the organizers encouraged me to start with a grabber, to engage the audience, by asking about going someplace cold for the holidays. This led naturally to me to being in Antarctica for the winter holidays, and thence into ARIANNA and neutrino astronomy. This may be the back door into the science, but times have changed, and it seemed to work well.
As scientists, we need to remember these lessons when we talk to non-scientists. Why should the audience care? Are we speaking to them or at them? Do we have an engaging presentation, with a good, clear story line? Is it at a level that they can follow?
These principles also apply to scientific presentations. How often have we sat through a seminar without any idea why the material is important to anybody? Or one filled with incomprehensible jargon or page-long equations relating variables that are not clearly defined? These are clear ways to avoid having to deal with job offers, etc. We need to do better.
So, ... thanks to Intuit, and Kara de Frias and Kimchi Tyler Chen (the lead organizers) for arranging a very interesting and educational day
Wednesday, August 20, 2014
Tuesday, July 22, 2014
The third times a charm... 5 sigma
My last several posts concerned the observation of extra-terrestrial neutrinos. The IceCube analysis, published in November, used 2 years of data to find evidence 'at the 4-sigma (standard deviation) level.' 4-sigma (standard deviations) refers to the statistical significance of the result. If the probabilities for our observation are described by a Gaussian ('normal') distribution, then 4-sigma corresponds to a roughly 1 in 16,000 probability of being a statistical fluctuation. This sounds like a pretty high standard, but, at least in physics, it is not normally considered enough to claim a discovery. There are two reasons for this.
The first is known as 'trials factors.' If you have a complex data set, and a powerful computer, it is pretty easy to do far more than 16,000 experiments, by, for example, looking in different regions of the sky, looking at different types of neutrinos, different energies, etc. Of course, within a single analysis, we keep track of the trial factors - in a search for point sources of neutrinos, we know how many different (independent) locations we are looking in, and how many energy bins, etc. However, this becomes harder when there are multiple analyses looking for different things. If we publish 9 null results and one positive one, should we dilute the 1 in 16,000 to 1 in 1,600?
In the broader world of science, it is well known that it is easier (and better for ones career) to publish positive results rather than upper limits. So, the positive results are more likely to be published than negative. Cold fusion (which made a big splash in the late 1980's) is a shining example of this. When it was first reported, many, many physics departments set up cells to search for cold fusion. Most of them didn't find anything, and quietly dropped the subject. However, the few that saw evidence for cold fusion published their results. The result was that a literature search could find almost as many positive results as negative ones. However, if you asked around, the ratio was very different.
The second reason is that the probability distribution may not be described by a Gaussian normal distribution, for any of a number of reasons. One concerns small numbers; if there are only a few events seen, then the distributions are better described by a Poisson distribution than a Gaussian. Of course, we know how to handle this now. The second reason is more nebulous - there may be systematic uncertainties that are not well described by a Gaussian distribution. Or, there may be unknown correlations between these systematic uncertainties. We try to account for these factors in assessing significance, but this is a rather difficult point.
Anyway, that long statistical digression explains why our November paper was entitled "Evidence for..." rather than "Discovery of..."
Now, we have released a new result, available at http://arxiv.org/abs/arXiv:1405.5303. The analysis has been expanded to include a third year of data, without any other changes. The additional year of data included another 9 events, including Big Bird. The data looked much like the first two years, and so pushed the statistical significance up to 5.7 sigma. Leading to the title "Observation of..." Of course, 5 sigma doesn't guarantee that a result is correct, but this one looks pretty solid.
With this result, we are now moving from trying to prove the existence of ultra-high energy astrophysical neutrinos to characterizing the flux and, from that, hopefully, finally pinning down the source(s) of the highest energy cosmic rays.
The first is known as 'trials factors.' If you have a complex data set, and a powerful computer, it is pretty easy to do far more than 16,000 experiments, by, for example, looking in different regions of the sky, looking at different types of neutrinos, different energies, etc. Of course, within a single analysis, we keep track of the trial factors - in a search for point sources of neutrinos, we know how many different (independent) locations we are looking in, and how many energy bins, etc. However, this becomes harder when there are multiple analyses looking for different things. If we publish 9 null results and one positive one, should we dilute the 1 in 16,000 to 1 in 1,600?
In the broader world of science, it is well known that it is easier (and better for ones career) to publish positive results rather than upper limits. So, the positive results are more likely to be published than negative. Cold fusion (which made a big splash in the late 1980's) is a shining example of this. When it was first reported, many, many physics departments set up cells to search for cold fusion. Most of them didn't find anything, and quietly dropped the subject. However, the few that saw evidence for cold fusion published their results. The result was that a literature search could find almost as many positive results as negative ones. However, if you asked around, the ratio was very different.
The second reason is that the probability distribution may not be described by a Gaussian normal distribution, for any of a number of reasons. One concerns small numbers; if there are only a few events seen, then the distributions are better described by a Poisson distribution than a Gaussian. Of course, we know how to handle this now. The second reason is more nebulous - there may be systematic uncertainties that are not well described by a Gaussian distribution. Or, there may be unknown correlations between these systematic uncertainties. We try to account for these factors in assessing significance, but this is a rather difficult point.
Anyway, that long statistical digression explains why our November paper was entitled "Evidence for..." rather than "Discovery of..."
Now, we have released a new result, available at http://arxiv.org/abs/arXiv:1405.5303. The analysis has been expanded to include a third year of data, without any other changes. The additional year of data included another 9 events, including Big Bird. The data looked much like the first two years, and so pushed the statistical significance up to 5.7 sigma. Leading to the title "Observation of..." Of course, 5 sigma doesn't guarantee that a result is correct, but this one looks pretty solid.
With this result, we are now moving from trying to prove the existence of ultra-high energy astrophysical neutrinos to characterizing the flux and, from that, hopefully, finally pinning down the source(s) of the highest energy cosmic rays.
Big Bird gets Energy
In a previous post, I wrote about our most energetic neutrino, Big Bird, but could not give you its energy. I am happy to report that the energy has now been made public: 2.0 PeV, within about 12% (assuming that it is an electromagnetic cascade). This is the most energetic neutrino yet seen. For comparison, the energy of each proton circulating in the LHC beams at full energy (which will not be achieved until later this year) is about 0.007 PeV, 285 times lower.
Friday, December 20, 2013
Awards Roll in for IceCube
The IceCube observation of astrophysical neutrinos has been nicely (and quickly!) recognized.
First, Physics World magazine recognized us their 2013 "Breakthrough of the year". IceCube wont he top honors, beating out nine other stories, including the Rex-Isolde observation that some atomic nuclei are pear-shaped.
Then, Scientific American selected IceCube as one of their top 10 science stories of 2013.
All-in-all, it was a pretty darn good month for IceCube.
First, Physics World magazine recognized us their 2013 "Breakthrough of the year". IceCube wont he top honors, beating out nine other stories, including the Rex-Isolde observation that some atomic nuclei are pear-shaped.
Then, Scientific American selected IceCube as one of their top 10 science stories of 2013.
All-in-all, it was a pretty darn good month for IceCube.
Wednesday, November 27, 2013
Big Bird joins Bert and Ernie
Bert and Ernie have company!
IceCube has found another PeV neutrino, event more energetic than Bert
or Ernie. The pictures below shows the IceCube standard event display, with side and top views. Unfortunately, some of the optical modules
see so much light that you can’t see what’s happening near the neutrino
interaction. In fact, the photodetectors
in the optical modules are badly saturated. The two event displays below show the side and top views of Big Bird; the enormous hit in the nearby DOMs overwhelms the image. Each colored sphere represents an optical module that observed light; the colors show the relative time of the hit, from red (earliest) through orange and yellow. The size of the spheres shows the amount of light detected.
Like Bert and Ernie, it is well contained within the detector, with no sign of early hits that might signal an entering muon; it is quite clearly a neutrino induced cascade (particle shower).
The event was found by LBNLs Lisa Gerhardt, on her last day working on IceCube, before she moved to a position focused on high-performance computing - still at LBNL, but now at the National Energy Research Supercomputer Center). Talk about going out in style!
I was privileged to be able to first show this event at the 2013 International Cosmic
Ray Conference (ICRC), in Rio de Janeiro, Jul2 2-9th. I would have loved to blog about it earlier,
but the only available reference is the writeup of my talk. Because that writeup covers the evidence for extra-terrestrial neutrinos (my last two posts), we agreed not to post it publicly until the Science paper appeared. Now that the Science paper is out, the writeup is available on the Cornell preprint server as arXiv:1311.6519.
Unfortunately, the collaboration decided not to release any
information on the event energy or direction, pending a systematic analysis,
but it is a nice little monster. As you should expect, we are working hard on these analyses, so I should be able to say more in the not too distant future.
Friday, November 22, 2013
Public Access to "Evidence for High-Energy Extraterrestrial Neutrinos at the IceCube Detector"
Our Science paper has now been posted to the Cornell preprint server (arXiv), and is available at
http://arxiv.org/abs/1311.5238
Click on the 'PDF' link on the upper right to get the complete text.
For those of you not familiar with science publishing, the preprint server contains the full text (as of today) of 892,854 scientific papers, covering most of physics and math, as uploaded by the authors. In high-energy and nuclear physics, virtually every relevant paper is uploaded to the server, usually at the same time that it is submitted to a journal or conference proceedings. Although it does not provide the benefits of peer review, it does provide quick access to the latest work - papers appear between 24 and 48 hours after they are uploaded.
The server also has a search facility, but, for particle/nuclear physics, I prefer INSPIRE . INSPIRE isn't perfect, but it has broader coverage than the arXiv, since it provides overage before 1995, when the arXiv was established. The arXiv coverage was also very spotty for the first ~ decade of operation. INSPIRE also covers most of the relevant articles that are not uploaded to the arXiv.
http://arxiv.org/abs/1311.5238
Click on the 'PDF' link on the upper right to get the complete text.
For those of you not familiar with science publishing, the preprint server contains the full text (as of today) of 892,854 scientific papers, covering most of physics and math, as uploaded by the authors. In high-energy and nuclear physics, virtually every relevant paper is uploaded to the server, usually at the same time that it is submitted to a journal or conference proceedings. Although it does not provide the benefits of peer review, it does provide quick access to the latest work - papers appear between 24 and 48 hours after they are uploaded.
The server also has a search facility, but, for particle/nuclear physics, I prefer INSPIRE . INSPIRE isn't perfect, but it has broader coverage than the arXiv, since it provides overage before 1995, when the arXiv was established. The arXiv coverage was also very spotty for the first ~ decade of operation. INSPIRE also covers most of the relevant articles that are not uploaded to the arXiv.
Thursday, November 21, 2013
"Evidence for high-energy extra-terrestrial neutrinos" on the cover of Science
This weeks issue of Science has a the IceCube paper
that we’ve all been waiting for: Evidence for high-energy extra-terrestrial neutrinos. The paper describes a follow-on analysis to
Bert and Ernie (our two 1-PeV neutrinos. The analysis was designed to find more
events like Bert and Ernie. It did
not. It did, however, find 28 events
that appeared to come from interactions within the detector, with no evidence
of an incoming muon track as expected from downward-going cosmic ray muons. One
of the events even made the cover of Science. Unfortunately, Science requires a subscription, but we will release freely-available version of the paper this afternoon; I'll post the URL when it comes out.
The
thing that makes this analysis so successful is that it brought together
multiple techniques to reject most background and estimate the reset, leading
to a convincing detection of a 4-sigma excess of events above the background
level expected from atmospheric neutrinos.
The first technique has been around since the first IceCube cascade
analysis: using the edges of the detector for a veto, with a smaller fiducial
(active) volume in the center. This
eliminates most background from downward-going muons entering the
detector. These downward-going muons
outnumber the neutrinos by 500,000 to 1, and estimating the fraction that
sneaks through the veto region is tricky, requiring voluminous simulations. The new
analysis uses a data-driven estimate instead.
The estimate uses two independent nested veto regions surrounding a
smaller fiducial volume. It counts events
tagged in the outer veto which miss the inner veto to determine the veto miss
fraction.
The other background is atmospheric neutrinos. These are, on average, less energetic than
the extra-terrestrial events. The new
analysis considers the expected energy spectrum, but it adds a new handle. Energetic downward-going atmospheric neutrinos
should be accompanied by a cosmic-ray muons which may trigger the veto
mentioned above, so they are less likely to pass the final event
selection. The new study is the first
one to search for downward-going cascades.
This atmospheric neutrino ‘self-veto’
probability is included in the background estimates. The background estimates also took advantage
of the latest IceCube measurements of the atmospheric neutrino rates.
In total, our best estimate of the background was 12.1
events (including 1.5 ‘prompt’ atmospheric neutrinos from the decay of charmed
particles), giving a significance as an extra-terrestrial signal ‘at the
4-sigma level.’ Of course, there are
some caveats, but this looks like a fairly robust detection, especially with
Bert and Ernie.
The energy spectrum of the events is shown in the figure above (the points with errors). The blue
histogram shows the atmospheric neutrino background, while the magenta and
green lines include two estimates of the prompt atmospheric neutrinos; the
shading shows the uncertainty. The red
shows the remaining downward-going muon background, while the grey line
includes these backgrounds, plus an assumed astrophysical component. The extra-terrestrial signal is significant
starting at energies above 60 TeV. The
absence of events at energies much above 1 PeV is significant, indicating that
the spectrum is cut off at very high energies (between 2 and 10 PeV); this may
be a clue about the accelerators that produced the neutrinos.
The apparent flux of extra-terrestrial neutrinos is toward the high end of current theoretical estimates, near the Waxman-Bahcall (WB) bound. The WB bound is a calculation based on the measured cosmic-ray flux, assuming that, when these particles are accelerated, they interact with background gas or photons (light) in the accelerator, producing particles (pions) which decay, producing the neutrinos that IceCube observes. Further studies, with more data, should give us clues which will help us located these accelerators.
For comparison, the only other observations of
extra-terrestrial neutrinos have been from our Sun (created by the nuclear
fusion that powers it) and a short burst of neutrinos when supernova 1987a
exploded. These neutrinos were all a
million times lower in energy than the ones that IceCube observed.
Many institutions
have issued press releases and feature stories about the paper, A few of them are
My apologies for the length and technical level of this
post, but this analysis is quite intricate, and I wanted to do it justice.
Subscribe to:
Posts (Atom)




