Teri Biebel was drained and exhausted. Not just from a long shift at the casino where she worked, but from 24 years in the casino industry. She was ready for a change. So one afternoon Teri called her friend Holly at Shepherd University to see if there were any job openings at the school. There weren’t. But Shepherdstown, West Virginia is a tight-knit community, and Holly had spoken with SkyTruth Board Member Paul Woods at a recent Rotary Club meeting. Paul had mentioned that SkyTruth was looking for an office administrator.
“We both didn’t know what SkyTruth did,” Teri says now. “Holly said something like ‘they use radar to do stuff. Let me contact Paul.’” Paul told SkyTruth President John Amos that someone was interested in the job. When John called Teri to see if she wanted to meet. Teri said, “absolutely. I hate what I’m doing.”
Teri grew up in Wildwood, New Jersey, on the beach and not far from Atlantic City. She and her husband Don both worked at the casinos, and Don also served in the Navy Reserve (after a six-year career in active duty). Soon after he returned from his deployment to Kuwait in 2005-2006, Teri and Don took a much-needed vacation together in Hawaii. It was there that they got the call: The casino was downsizing. Don had lost his job.
Both of them soon found work at the casino in Charles Town, West Virginia and settled in nearby Shepherdstown. With two young daughters, they worked alternate shifts. But Teri became tired of taking people’s money. She remembers one customer who won a million dollars, but then gambled it all away and ended up losing everything: his home, his job, and his million dollars.
When John met Teri he was impressed with her professional experience, but also her recent personal accomplishments: Teri had just run her first marathon and lost 60 pounds in the process. “She had a lot of responsibility in her previous jobs at the casinos,” says John. “And we needed someone who could handle that level of responsibility. I was still the only SkyTruth employee at that point, so I needed someone I could depend on.“ The fact that she had trained for and run a marathon “said a lot about her,” according to John, and what she could accomplish.
Teri started in December 2010 and has watched SkyTruth grow from two employees to 10 or more now. She recalls that on her first or second day she attended a SkyTruth board meeting to take notes. That was when she first saw John in action. “When John talks he commands attention,” she says now. “You want to hear more. I never knew this stuff existed, that you could use satellite imagery to track oil spills or anything.” She likes her job at SkyTruth because she learns so much. In addition to her office administration duties, Teri has tracked oil pollution in the ocean using imagery, including the years-long spill at the Taylor Energy site in the Gulf of Mexico. (Thanks to SkyTruth’s dogged tracking of this spill, the Coast Guard finally ordered the company to fix the leak last year.) “This is my ninth year at SkyTruth and I’m still fascinated with all the things that we can see and do and change,” she says.
Perhaps even more importantly, “I feel like we’re helping people. We’re providing this data to help people see what’s going on around them… It’s a huge contrast” from her old job she says. “I feel like I’m doing good now.”
The Biebel family selfie
The move to Shepherdstown has also been good for Teri’s daughters Jenn and Amanda. Both are now students at West Virginia University and are skilled musicians. The band program in the local high school “is second to none,” according to Teri and both her girls benefited greatly from the experience. In fact, Jenn, who plays trumpet, was nominated by her band director in high school, and accepted, into the US Army All American Marching Band. The Army flew her and 124 other American high school students to San Antonio, Texas for a week. They toured the Alamo and the San Antonio River Walk, and then marched at the Army All-American High School Bowl Game (comprised of high school seniors from around the country). “I’m not sure they would have had that [band] experience if we stayed in New Jersey,” says Teri. She wrote about one of her own profound experiences during the San Antonio trip for her blog Snarkfest (a blog she describes as “thoughts from a totally snarkastic Mom”).
And despite a few lapses to raise her girls, Teri has kept running. So far, she has run three full marathons, 21 half marathons and two Tough Mudders. Tough Mudders are 10-mile races with two or three obstacles each mile. Later this month she’ll be running the Marine Corps Marathon in Washington D.C. for the second time. With her daughters away at college, Teri has found time for long training runs again. She also has discovered that, as she puts it, “being an empty nester isn’t as bad as I thought. I miss all that [childhood] stuff….But my girls are where they need to be. It’s time for me now.”
Note: This post was updated 10/8/19 to correct Don’s time in the Navy.
https://skytruth.org/wp-content/uploads/2019/10/teri_crop.jpg423640Amy Mathews/wp-content/uploads/2016/08/test_logo.pngAmy Mathews2019-10-07 17:42:342019-10-08 13:55:17Teri Biebel Found Her Fit at SkyTruth
To analyze satellite data for environmental impacts, computers need to be trained to recognize objects.
The vast quantities of satellite image data available these days provide tremendous opportunities for identifying environmental impacts from space. But for mere humans, there’s simply too much — there are only so many hours in the day. So at SkyTruth, we’re teaching computers to analyze many of these images for us, a process called machine learning. The potential for advancing conservation with machine learning is tremendous. Once taught, computers potentially can detect features such as roads infiltrating protected areas, logging decimating wildlife habitat, mining operations growing beyond permit boundaries, and other landscape changes that reveal threats to biodiversity and human health. Interestingly, the techniques we use to train computers rely on the same techniques used by people to identify objects.
When people look at a photograph, they find it quite easy to identify shapes, features, and objects based on a combination of previous experience and context clues in the image itself. When a computer program is asked to describe a picture, it relies on the same two strategies. In the image above, both humans and computers attempting to extract meaning and identify object boundaries would use similar visual cues:
Colors (the bedrock is red)
Shapes (the balloon is oval)
Lines (the concrete has seams)
Textures (the balloon is smooth)
Sizes (the feet are smaller than the balloon)
Locations (the ground is at the bottom)
Adjacency (the feet are attached to legs)
Gradients (the bedrock has shadows)
While none of the observations in parentheses capture universal truths, they are useful heuristics: if you have enough of them, you can have some confidence that you’ve interpreted a given image correctly.
Pixel Mask
If our objective is to make a computer program that can find the balloon in the picture above as well as a human can, then we first need to create a way to compare the performances of computers and humans. One solution is to task both a person and a computer to identify, or “segment,” all the pixels that are part of the balloon. If results from the computer agree with those from the person, then it is fair to say that the computer has found the balloon. The results are captured in an image called a “mask,” in which every pixel is either black (not balloon) or white (balloon), like the following image.
However, unlike humans, most computers don’t wander around and collect experiences on their own. Computers require datasets of explicitly annotated examples, called “training data,” to learn to identify and distinguish specific objects within data. The black and white mask above is one such example. After seeing enough examples of an object, a computer will have embedded some knowledge about what differentiates balloons from their surroundings.
Well Pad Discovery
At SkyTruth, we are starting our machine learning process with oil and gas well pads. Well pads are the base of operations for most active oil and gas drilling sites in the United States, and we are identifying them as a way to quantify the impact of these extractive industries on the natural environment and neighboring communities. Well pads vary greatly in how they appear. Just take a look at how different these three are from each other.
Given this diversity, we need to provide the computer many examples, so that the machine learning model we are creating can distinguish between important features that characterize well pads (e.g. having an access road) and unimportant ones that are allowed to vary (e.g. the shape of the well pad, or the color of its surroundings). Our team generates masks (the black and white pixel labels) for these images by hand, and inputs them as “training data” into the computer. We provide both the image and its mask separately to the machine learning model, but for the rest of this post we will superimpose the mask in blue.
Finally, our machine learning model looks at each image (about 120 of them), learns a little bit from the mask provided with it, and then moves onto the next image. After looking at each picture once, it has already reached 92% accuracy. But we can then tell it to go back and look at each one again (about 30 times), and add a little more detail to its learning, until it reaches almost 98% accuracy.
After the model is trained, we can feed it raw satellite images and ask it to create a mask that identifies all the pixels belonging to any well pads in the picture. Here are some actual outputs from our trained machine learning model:
The top three images show well pads that were correctly identified, and fairly well masked — note the blue mask overlaying the well pads. The bottom three images do not contain well pads, and you can see that our model ignores forests, fields, and houses very well in the first two images, but is a little confused by parking lots — it has masked the parking lot in the third image in blue (incorrectly), as if it were a well pad. This is reasonable, as parking lots share many features with well pads — they are usually rectangular, gray, contain vehicles, and have an access road. This is not the end of the machine learning process; rather it is a first pass through that informs us of a need to capture more images of parking lots and further train the model that those are negative examples.
When working on image segmentation, there are a number of challenges that we need to mitigate.
Biased Training Data
Predictions that the computer makes are based solely on training data, so it is possible for idiosyncrasies in the training data set to be encoded (unintentionally) as meaningful. For instance, imagine a model that detects a person’s happiness from a picture of their face. If it is only shown open-mouth smiles in the training data, then it is possible that when presented with real world images, it classifies closed-mouth smiles as unhappy.
This challenge often affects a model in unanticipated ways because those biases can be inherent in the data scientist. We try to mitigate this by making sure that our training dataset comes from the same set of images as those that we need to be automatically classified. Two examples of how biased data might creep into our work are: training a machine learning model on well pads in Pennsylvania and then asking it to identify pads from California (bias in the data source), or training a model on well pads centered in the picture, and then asking it to identify them when halfway out of the image (bias in the data preprocessing).
Garbage In, Garbage Out
The predictions that the computer makes can only be as good as the samples that we provide in the training data. For instance, if the person responsible for training accidentally includes the string of a balloon in half of the images created for the training dataset and excludes it in the other half, then the model will be confused about whether or not to mask the string in its predictions. We try to mitigate this by adhering to strict explicit guidelines about what constitutes the boundary of a well pad.
Measuring Success
In most other machine learning systems, it is useful to measure success as a product of two factors. First, was the guess right or wrong? And second, how confident was the guess? However, in image segmentation, that is not a great metric, because the model can be overwhelmed by an imbalance between the number of pixels in each class. For instance, imagine the task is to find a single ant on a large white wall. Out of 1000 white pixels, only 1 is gray. If your model makes a mask that searches long and hard and guesses that one pixel correctly, then it gets 100% accuracy. However, a much simpler model would say there is no ant, that every pixel is white wall, and get rewarded with 99.9% accuracy. This second model is practically unusable, but is very easy for a training algorithm to achieve.
We mitigate this issue by using a metric known as the F-beta score, which for our purposes avoids objects that are very small being ignored in favor of ones that are very large. If you’re hungry for a more technical explanation of this metric, check out the Wikipedia page.
Next Steps
In the coming weeks we will be creating an online environment in which our machine learning model can be installed and fed images with minimal human guidance. Our objective is to create two pipelines: the first allows training data to flow into the model, so it can learn. The second allows new images from satellites to flow into the model, so it can perform image segmentation and tell us the acreage dedicated to these well pads.
We’ll keep you posted as our machine learning technology progresses.
Update 2019-12-13:
In a major step forward, we set up Google SQL and Google Storage environments to house a larger database of training data, containing over 2000 uniquely generated polygons that cover multiple states in the Colorado River Basin. The GeoJSON is publicly available for download at https://skytruth-org.carto.com/maps. These data were used as fodder for a deep learning neural network, which was trained in this iPython notebook. We reached DICE accuracies up to 86.3%. The trained models were then used to run inference on sites that were permitted for drilling to identify the extent of the well pads in this second iPython notebook.
https://skytruth.org/wp-content/uploads/2019/09/edrece-stansberry-qGi-RZm6kCk-unsplash.jpg26724000Jona Raphael/wp-content/uploads/2016/08/test_logo.pngJona Raphael2019-09-30 05:00:102019-12-13 11:57:52Training Computers to See What We See
SkyTruth is both an intensely local and vibrantly global organization. Based in Shepherdstown, West Virginia, many of our highly talented staff are long-time residents (and some were even born and raised here). That makes our work on Appalachian issues such as mountaintop mining and fracking personal − it’s happening in our backyard, typically with little oversight from government agencies. But confronting global environmental challenges sometimes means reaching beyond local borders and finding the right people to take on a task that no one else has tackled before. And so SkyTruth’s family of staff and consultants includes programmers and others from around the world, plus top notch research partners at universities and other institutions.
The SkyTruth team in Shepherdstown, West Virginia. Photo by Hali Taylor.
As SkyTruth’s new Writer–Editor, I plan to bring you their stories in coming months, to add to the remarkable findings and tools the staff regularly share through this blog. We’ll learn more about the people whose passion propels our cutting-edge work. And we’ll learn more about all of you – the SkyTruthers who use these tools and information to make a difference in the world. We’ll share your impact stories: That is, how you’ve made a difference in your neighborhood, state, nation or the world at large.
To start, I’ll share a little bit about myself. As a kid, stories hooked me on conservation. I used to watch every National Geographic special I could find and never missed an episode of Wild Kingdom (remember that?). My fascination with all things wild led me to major in wildlife biology at Cornell University. But I quickly realized that I wasn’t a scientist at heart − I was more interested in saving creatures than studying them. I spent spring semester of my junior year in Washington, D.C. and shifted my focus to environmental policy. That decision led to dual graduate degrees in environmental science and public affairs at Indiana University and a long career in environmental policy analysis, program evaluation, and advocacy in Washington.
Urban life and policy gridlock eventually pushed me to Shepherdstown, where nature was closer at hand. I became involved in Shepherdstown’s American Conservation Film Festival, which reignited my passion for storytelling and the inspiration it can trigger. And so, after years of working and consulting for the federal government, conservation groups and charitable foundations, I returned to my conservation roots. I completed my M.A. in nonfiction writing at Johns Hopkins University in May 2013 and left my policy work behind.
Radio-collared Mexican wolf. Photo courtesy of U.S. Fish & Wildlife Service.
Since then, my writing has appeared in publications such as The Washington Post, Pacific Standard, Scientific American, High Country News, Wonderful West Virginia and other outlets. In fact, my 2018 story on the endangered Mexican wolf for Earth Touch News recently won a Genesis Award from the Humane Society of the United States for Outstanding Online News. I was thrilled to be able to observe a family of wolves as part of my reporting for that story, and I always welcome new opportunities to go out in the field and learn about the important work conservationists are doing.
During my time as a freelance journalist, I also led workshops for the nonprofit science communication organization COMPASS, teaching environmental (and other) scientists how to communicate their work more effectively to journalists, policymakers, and others.
There’s one more thing I’d like to share: Although my official role at SkyTruth as Writer–Editor is new, I’ve known SkyTruth since its very beginning. I still remember the day SkyTruth founder John Amos and I sat down at our dining room table and he told me his vision for a new nonprofit. His goal was to level the playing field by giving those trying to protect the planet the same satellite tools used by industries exploiting the planet. John is my husband, and SkyTruth’s journey has been exciting, frightening, gratifying, and sometimes frustrating, with many highs and the occasional low. But it has never been boring.
I’m looking forward to sharing SkyTruth stories with all of you, making sure they move beyond the dining room table to your homes and offices, inspiring you, your colleagues, your friends and families to make the most of what SkyTruth has to offer. Feel free to reach out to me at info@skytruth.org if you’d like to share how you’ve used SkyTruth tools and materials. Just include my name in the subject line and the words “impact story.” Let’s talk!
Note: Portions of this text first appeared on the website amymathewsamos.com.
[This analysis of oil pollution in the waters of southeast Asia was written as part of a collaborative effort between SkyTruth team members Lucy Meyer and Brendan Jarrell.]
Our routine monitoring of the world’s oceans has led to some extraordinary findings. For example, in previous updates, we’ve identified oil slicks in traffic-heavy locations like the Strait of Malacca. But as you’ll see in this post, bilge dumps occur elsewhere in southeast Asia.
Those who follow our posts are probably familiar with how we identify vessels at sea. To new readers, let us explain what bilge dumping is and how we identify potentially responsible vessels. Bilge dumping is the disposal of waste water from a ship’s lower hull. Bilge water is supposed to be treated before it’s discharged, but sometimes vessel operators will bypass the pollution control equipment and flush oily, untreated bilge into the ocean – in direct violation of marine pollution law. We use images from satellites to monitor for illegal bilge dumping. In satellite imagery, oily bilge dumps usually form distinctive linear slicks. By matching the time of the imagery to broadcasts from a vessel tracking service called automatic identification system (AIS), we can determine the identity of vessels that appear to be causing the slicks. We used this process to identify the vessel associated with a long bilge slick in Figure 1 below.
Figure 1: A vessel shown passing through the Sunda Strait, identified as the Sungai Gerong, apparently trailing a long oily bilge slick.
This Sentinel-1 radar satellite image from July 2nd shows a slick about 177 kilometers long around the southwest tip of Banten Province, Island of Java, Indonesia (Figure 1). In the yellow box, you can see a vessel at the head of the slick. By investigating AIS broadcasts from exactEarth’s ShipView service, we identified an Indonesian oil products tanker named the Sungai Gerong as the likely vessel. The satellite scene, captured at 22:33 UTC (Coordinated Universal Time), shows a slick that closely aligns to the AIS broadcasts from the Sungai Gerong.
You’ll probably notice that the tail-end of the slick is a bit contorted and offset from the track of the Sungai Gerong. The slick’s appearance was likely influenced by ocean currents and local weather conditions between the time of the ship’s passing and when the image was taken. Global wind maps show that there were 10-15 knot winds blowing northwest up to six hours before the image was acquired. This data suggests that wind likely impacted the slick’s appearance. As a result, we believe that the Sungai Gerong is the likely source of this slick.
Using AIS, we tracked the Sungai Gerong as it traveled north through the Sunda Strait — the body of water between the Indonesian islands of Java and Sumatra — to the port of Jakarta. Similar to the Strait of Malacca, the Sunda is an important waterway that connects the Indian Ocean to the Java Sea. Though not as dense with marine traffic as the Malacca Strait, the Sunda is still subjected to pollution from vessels.
We also recently identified two suspected bilge dumps in the Philippines (Figure 2). Occurring on July 6th in the South China Sea, a 238 kilometer long slick behind the vessel in this Sentinel-1 radar image looks like a bilge dump. The Philippine island of Palawan, a popular tourist destination for its beautiful natural landscape, appears on the right side of the map frame. Another smaller slick without a known source is visible to the left of the larger slick.
Figure 2: The Ulaya makes its way through the South China Sea. Palawan Island, a part of the Philippines, can be seen to the right.
Using AIS broadcasts from ShipView, we identified the Ulaya, a Thai oil tanker, as a possible source of the slick. The last AIS broadcast from the Ulaya (seen directly above the ship) was transmitted fifteen minutes before the image was captured. These AIS broadcasts give us reason to believe that the Ulaya could be responsible for this slick. Moreover, ShipView shows that the vessel was headed towards the Port of Belawan in the Strait of Malacca with a shipment of Dangerous Goods. According to the International Maritime Organization, a United Nations agency that regulates global shipping, chemicals falling under this classification are “hazardous to marine environments.” Thus, a slick from this ship could be of greater concern than usual.
These examples show that bilge dumping continues to be a problem in the waters of southeast Asia. But with satellite imagery, anyone, anywhere can see what’s happening on the water and help to raise the alarm. We hope that our persistent and careful surveillance will inspire others to pressure policy makers, government regulators, and the shipping industry to take strong, coordinated action to stop bilge dumping.
https://skytruth.org/wp-content/uploads/2019/07/lucymap.jpeg11311600Lucy Meyer/wp-content/uploads/2016/08/test_logo.pngLucy Meyer2019-07-31 12:49:492019-11-19 12:43:32More oil pollution in southeast Asia: suspected bilge dumping off Indonesia and The Philippines
Following up on recent reports of oil in the water off the north coast of Karawang Regency, West Java, Indonesia, SkyTruth has picked up a slick in Sentinel-1 radar imagery. In the image from July 18th, an unidentified platform (circled in red) located roughly 12 km north of the Karawang shore is shown emitting a 34.7 km-long slick into the Java Sea. A story written by the local Jakarta Post on July 18th describes state-owned energy firm Pertamina’s decision to evacuate personnel and halt operations at an offshore production rig in their Offshore Northwest Java (ONWJ) block. The evacuation was ordered after a dangerous “well kick”, or unplanned release of gas caused by low pressure in a wellbore, initiated a large slick on the 16th of July. A separate report released by the Jakarta Post five days later indicated that the Indonesian Transportation Ministry teamed up with Pertamina in response to the oil-related event, along with several other smaller entities in the area. The response vessels were able to set up a boom around the perimeter of the offshore platform. Unfortunately, this didn’t stop oil from reaching villages and beaches on West Java’s coast. Given the fact that several vessels surround the unidentified object in the Sentinel-1 image, we believe that this could be the affected drilling platform. Pertamina’s upstream director Dharmawan Samsu estimated that it will take approximately eight weeks for the oil and gas leakage to be plugged.
The unidentified platform (circled in red) can be seen leaking oil into the Java Sea. Several small vessels are in the platform’s proximity.
SkyTruth and/or its third party tools use cookies to monitor traffic in the aggregate on our websites and applications and to improve user experience. If you continue browsing, we'll assume you agree to the use of cookies. You can change your cookie settings at any time in your browser settings. Find out more in our privacy policy.
Teri Biebel Found Her Fit at SkyTruth
/in SkyTruth Spotlight /by Amy MathewsDoing Good Through SkyTruth
Teri Biebel was drained and exhausted. Not just from a long shift at the casino where she worked, but from 24 years in the casino industry. She was ready for a change. So one afternoon Teri called her friend Holly at Shepherd University to see if there were any job openings at the school. There weren’t. But Shepherdstown, West Virginia is a tight-knit community, and Holly had spoken with SkyTruth Board Member Paul Woods at a recent Rotary Club meeting. Paul had mentioned that SkyTruth was looking for an office administrator.
“We both didn’t know what SkyTruth did,” Teri says now. “Holly said something like ‘they use radar to do stuff. Let me contact Paul.’” Paul told SkyTruth President John Amos that someone was interested in the job. When John called Teri to see if she wanted to meet. Teri said, “absolutely. I hate what I’m doing.”
Teri grew up in Wildwood, New Jersey, on the beach and not far from Atlantic City. She and her husband Don both worked at the casinos, and Don also served in the Navy Reserve (after a six-year career in active duty). Soon after he returned from his deployment to Kuwait in 2005-2006, Teri and Don took a much-needed vacation together in Hawaii. It was there that they got the call: The casino was downsizing. Don had lost his job.
Both of them soon found work at the casino in Charles Town, West Virginia and settled in nearby Shepherdstown. With two young daughters, they worked alternate shifts. But Teri became tired of taking people’s money. She remembers one customer who won a million dollars, but then gambled it all away and ended up losing everything: his home, his job, and his million dollars.
When John met Teri he was impressed with her professional experience, but also her recent personal accomplishments: Teri had just run her first marathon and lost 60 pounds in the process. “She had a lot of responsibility in her previous jobs at the casinos,” says John. “And we needed someone who could handle that level of responsibility. I was still the only SkyTruth employee at that point, so I needed someone I could depend on.“ The fact that she had trained for and run a marathon “said a lot about her,” according to John, and what she could accomplish.
Teri started in December 2010 and has watched SkyTruth grow from two employees to 10 or more now. She recalls that on her first or second day she attended a SkyTruth board meeting to take notes. That was when she first saw John in action. “When John talks he commands attention,” she says now. “You want to hear more. I never knew this stuff existed, that you could use satellite imagery to track oil spills or anything.” She likes her job at SkyTruth because she learns so much. In addition to her office administration duties, Teri has tracked oil pollution in the ocean using imagery, including the years-long spill at the Taylor Energy site in the Gulf of Mexico. (Thanks to SkyTruth’s dogged tracking of this spill, the Coast Guard finally ordered the company to fix the leak last year.) “This is my ninth year at SkyTruth and I’m still fascinated with all the things that we can see and do and change,” she says.
Perhaps even more importantly, “I feel like we’re helping people. We’re providing this data to help people see what’s going on around them… It’s a huge contrast” from her old job she says. “I feel like I’m doing good now.”
The Biebel family selfie
The move to Shepherdstown has also been good for Teri’s daughters Jenn and Amanda. Both are now students at West Virginia University and are skilled musicians. The band program in the local high school “is second to none,” according to Teri and both her girls benefited greatly from the experience. In fact, Jenn, who plays trumpet, was nominated by her band director in high school, and accepted, into the US Army All American Marching Band. The Army flew her and 124 other American high school students to San Antonio, Texas for a week. They toured the Alamo and the San Antonio River Walk, and then marched at the Army All-American High School Bowl Game (comprised of high school seniors from around the country). “I’m not sure they would have had that [band] experience if we stayed in New Jersey,” says Teri. She wrote about one of her own profound experiences during the San Antonio trip for her blog Snarkfest (a blog she describes as “thoughts from a totally snarkastic Mom”).
And despite a few lapses to raise her girls, Teri has kept running. So far, she has run three full marathons, 21 half marathons and two Tough Mudders. Tough Mudders are 10-mile races with two or three obstacles each mile. Later this month she’ll be running the Marine Corps Marathon in Washington D.C. for the second time. With her daughters away at college, Teri has found time for long training runs again. She also has discovered that, as she puts it, “being an empty nester isn’t as bad as I thought. I miss all that [childhood] stuff….But my girls are where they need to be. It’s time for me now.”
Note: This post was updated 10/8/19 to correct Don’s time in the Navy.
Training Computers to See What We See
/in Tech Tools /by Jona RaphaelTo analyze satellite data for environmental impacts, computers need to be trained to recognize objects.
The vast quantities of satellite image data available these days provide tremendous opportunities for identifying environmental impacts from space. But for mere humans, there’s simply too much — there are only so many hours in the day. So at SkyTruth, we’re teaching computers to analyze many of these images for us, a process called machine learning. The potential for advancing conservation with machine learning is tremendous. Once taught, computers potentially can detect features such as roads infiltrating protected areas, logging decimating wildlife habitat, mining operations growing beyond permit boundaries, and other landscape changes that reveal threats to biodiversity and human health. Interestingly, the techniques we use to train computers rely on the same techniques used by people to identify objects.
Common Strategies for Detecting Objects
Photo by Edrece Stansberry on Unsplash
When people look at a photograph, they find it quite easy to identify shapes, features, and objects based on a combination of previous experience and context clues in the image itself. When a computer program is asked to describe a picture, it relies on the same two strategies. In the image above, both humans and computers attempting to extract meaning and identify object boundaries would use similar visual cues:
While none of the observations in parentheses capture universal truths, they are useful heuristics: if you have enough of them, you can have some confidence that you’ve interpreted a given image correctly.
Pixel Mask
If our objective is to make a computer program that can find the balloon in the picture above as well as a human can, then we first need to create a way to compare the performances of computers and humans. One solution is to task both a person and a computer to identify, or “segment,” all the pixels that are part of the balloon. If results from the computer agree with those from the person, then it is fair to say that the computer has found the balloon. The results are captured in an image called a “mask,” in which every pixel is either black (not balloon) or white (balloon), like the following image.
However, unlike humans, most computers don’t wander around and collect experiences on their own. Computers require datasets of explicitly annotated examples, called “training data,” to learn to identify and distinguish specific objects within data. The black and white mask above is one such example. After seeing enough examples of an object, a computer will have embedded some knowledge about what differentiates balloons from their surroundings.
Well Pad Discovery
At SkyTruth, we are starting our machine learning process with oil and gas well pads. Well pads are the base of operations for most active oil and gas drilling sites in the United States, and we are identifying them as a way to quantify the impact of these extractive industries on the natural environment and neighboring communities. Well pads vary greatly in how they appear. Just take a look at how different these three are from each other.
Given this diversity, we need to provide the computer many examples, so that the machine learning model we are creating can distinguish between important features that characterize well pads (e.g. having an access road) and unimportant ones that are allowed to vary (e.g. the shape of the well pad, or the color of its surroundings). Our team generates masks (the black and white pixel labels) for these images by hand, and inputs them as “training data” into the computer. We provide both the image and its mask separately to the machine learning model, but for the rest of this post we will superimpose the mask in blue.
Finally, our machine learning model looks at each image (about 120 of them), learns a little bit from the mask provided with it, and then moves onto the next image. After looking at each picture once, it has already reached 92% accuracy. But we can then tell it to go back and look at each one again (about 30 times), and add a little more detail to its learning, until it reaches almost 98% accuracy.
After the model is trained, we can feed it raw satellite images and ask it to create a mask that identifies all the pixels belonging to any well pads in the picture. Here are some actual outputs from our trained machine learning model:
The top three images show well pads that were correctly identified, and fairly well masked — note the blue mask overlaying the well pads. The bottom three images do not contain well pads, and you can see that our model ignores forests, fields, and houses very well in the first two images, but is a little confused by parking lots — it has masked the parking lot in the third image in blue (incorrectly), as if it were a well pad. This is reasonable, as parking lots share many features with well pads — they are usually rectangular, gray, contain vehicles, and have an access road. This is not the end of the machine learning process; rather it is a first pass through that informs us of a need to capture more images of parking lots and further train the model that those are negative examples.
When working on image segmentation, there are a number of challenges that we need to mitigate.
Biased Training Data
Predictions that the computer makes are based solely on training data, so it is possible for idiosyncrasies in the training data set to be encoded (unintentionally) as meaningful. For instance, imagine a model that detects a person’s happiness from a picture of their face. If it is only shown open-mouth smiles in the training data, then it is possible that when presented with real world images, it classifies closed-mouth smiles as unhappy.
This challenge often affects a model in unanticipated ways because those biases can be inherent in the data scientist. We try to mitigate this by making sure that our training dataset comes from the same set of images as those that we need to be automatically classified. Two examples of how biased data might creep into our work are: training a machine learning model on well pads in Pennsylvania and then asking it to identify pads from California (bias in the data source), or training a model on well pads centered in the picture, and then asking it to identify them when halfway out of the image (bias in the data preprocessing).
Garbage In, Garbage Out
The predictions that the computer makes can only be as good as the samples that we provide in the training data. For instance, if the person responsible for training accidentally includes the string of a balloon in half of the images created for the training dataset and excludes it in the other half, then the model will be confused about whether or not to mask the string in its predictions. We try to mitigate this by adhering to strict explicit guidelines about what constitutes the boundary of a well pad.
Measuring Success
In most other machine learning systems, it is useful to measure success as a product of two factors. First, was the guess right or wrong? And second, how confident was the guess? However, in image segmentation, that is not a great metric, because the model can be overwhelmed by an imbalance between the number of pixels in each class. For instance, imagine the task is to find a single ant on a large white wall. Out of 1000 white pixels, only 1 is gray. If your model makes a mask that searches long and hard and guesses that one pixel correctly, then it gets 100% accuracy. However, a much simpler model would say there is no ant, that every pixel is white wall, and get rewarded with 99.9% accuracy. This second model is practically unusable, but is very easy for a training algorithm to achieve.
We mitigate this issue by using a metric known as the F-beta score, which for our purposes avoids objects that are very small being ignored in favor of ones that are very large. If you’re hungry for a more technical explanation of this metric, check out the Wikipedia page.
Next Steps
In the coming weeks we will be creating an online environment in which our machine learning model can be installed and fed images with minimal human guidance. Our objective is to create two pipelines: the first allows training data to flow into the model, so it can learn. The second allows new images from satellites to flow into the model, so it can perform image segmentation and tell us the acreage dedicated to these well pads.
We’ll keep you posted as our machine learning technology progresses.
Update 2019-12-13:
In a major step forward, we set up Google SQL and Google Storage environments to house a larger database of training data, containing over 2000 uniquely generated polygons that cover multiple states in the Colorado River Basin. The GeoJSON is publicly available for download at https://skytruth-org.carto.com/maps. These data were used as fodder for a deep learning neural network, which was trained in this iPython notebook. We reached DICE accuracies up to 86.3%. The trained models were then used to run inference on sites that were permitted for drilling to identify the extent of the well pads in this second iPython notebook.
New Writer–Editor Amy Mathews Joins SkyTruth Team
/in SkyTruth Spotlight /by Amy MathewsTelling SkyTruth’s stories
SkyTruth is both an intensely local and vibrantly global organization. Based in Shepherdstown, West Virginia, many of our highly talented staff are long-time residents (and some were even born and raised here). That makes our work on Appalachian issues such as mountaintop mining and fracking personal − it’s happening in our backyard, typically with little oversight from government agencies. But confronting global environmental challenges sometimes means reaching beyond local borders and finding the right people to take on a task that no one else has tackled before. And so SkyTruth’s family of staff and consultants includes programmers and others from around the world, plus top notch research partners at universities and other institutions.
The SkyTruth team in Shepherdstown, West Virginia. Photo by Hali Taylor.
As SkyTruth’s new Writer–Editor, I plan to bring you their stories in coming months, to add to the remarkable findings and tools the staff regularly share through this blog. We’ll learn more about the people whose passion propels our cutting-edge work. And we’ll learn more about all of you – the SkyTruthers who use these tools and information to make a difference in the world. We’ll share your impact stories: That is, how you’ve made a difference in your neighborhood, state, nation or the world at large.
To start, I’ll share a little bit about myself. As a kid, stories hooked me on conservation. I used to watch every National Geographic special I could find and never missed an episode of Wild Kingdom (remember that?). My fascination with all things wild led me to major in wildlife biology at Cornell University. But I quickly realized that I wasn’t a scientist at heart − I was more interested in saving creatures than studying them. I spent spring semester of my junior year in Washington, D.C. and shifted my focus to environmental policy. That decision led to dual graduate degrees in environmental science and public affairs at Indiana University and a long career in environmental policy analysis, program evaluation, and advocacy in Washington.
Urban life and policy gridlock eventually pushed me to Shepherdstown, where nature was closer at hand. I became involved in Shepherdstown’s American Conservation Film Festival, which reignited my passion for storytelling and the inspiration it can trigger. And so, after years of working and consulting for the federal government, conservation groups and charitable foundations, I returned to my conservation roots. I completed my M.A. in nonfiction writing at Johns Hopkins University in May 2013 and left my policy work behind.
Radio-collared Mexican wolf. Photo courtesy of U.S. Fish & Wildlife Service.
Since then, my writing has appeared in publications such as The Washington Post, Pacific Standard, Scientific American, High Country News, Wonderful West Virginia and other outlets. In fact, my 2018 story on the endangered Mexican wolf for Earth Touch News recently won a Genesis Award from the Humane Society of the United States for Outstanding Online News. I was thrilled to be able to observe a family of wolves as part of my reporting for that story, and I always welcome new opportunities to go out in the field and learn about the important work conservationists are doing.
During my time as a freelance journalist, I also led workshops for the nonprofit science communication organization COMPASS, teaching environmental (and other) scientists how to communicate their work more effectively to journalists, policymakers, and others.
There’s one more thing I’d like to share: Although my official role at SkyTruth as Writer–Editor is new, I’ve known SkyTruth since its very beginning. I still remember the day SkyTruth founder John Amos and I sat down at our dining room table and he told me his vision for a new nonprofit. His goal was to level the playing field by giving those trying to protect the planet the same satellite tools used by industries exploiting the planet. John is my husband, and SkyTruth’s journey has been exciting, frightening, gratifying, and sometimes frustrating, with many highs and the occasional low. But it has never been boring.
I’m looking forward to sharing SkyTruth stories with all of you, making sure they move beyond the dining room table to your homes and offices, inspiring you, your colleagues, your friends and families to make the most of what SkyTruth has to offer. Feel free to reach out to me at info@skytruth.org if you’d like to share how you’ve used SkyTruth tools and materials. Just include my name in the subject line and the words “impact story.” Let’s talk!
Note: Portions of this text first appeared on the website amymathewsamos.com.
More oil pollution in southeast Asia: suspected bilge dumping off Indonesia and The Philippines
/in Bilge Dumping, Incidents, Oceans, Oil & Gas, Oil Spill, Watchdog /by Lucy Meyer[This analysis of oil pollution in the waters of southeast Asia was written as part of a collaborative effort between SkyTruth team members Lucy Meyer and Brendan Jarrell.]
Our routine monitoring of the world’s oceans has led to some extraordinary findings. For example, in previous updates, we’ve identified oil slicks in traffic-heavy locations like the Strait of Malacca. But as you’ll see in this post, bilge dumps occur elsewhere in southeast Asia.
Those who follow our posts are probably familiar with how we identify vessels at sea. To new readers, let us explain what bilge dumping is and how we identify potentially responsible vessels. Bilge dumping is the disposal of waste water from a ship’s lower hull. Bilge water is supposed to be treated before it’s discharged, but sometimes vessel operators will bypass the pollution control equipment and flush oily, untreated bilge into the ocean – in direct violation of marine pollution law. We use images from satellites to monitor for illegal bilge dumping. In satellite imagery, oily bilge dumps usually form distinctive linear slicks. By matching the time of the imagery to broadcasts from a vessel tracking service called automatic identification system (AIS), we can determine the identity of vessels that appear to be causing the slicks. We used this process to identify the vessel associated with a long bilge slick in Figure 1 below.
This Sentinel-1 radar satellite image from July 2nd shows a slick about 177 kilometers long around the southwest tip of Banten Province, Island of Java, Indonesia (Figure 1). In the yellow box, you can see a vessel at the head of the slick. By investigating AIS broadcasts from exactEarth’s ShipView service, we identified an Indonesian oil products tanker named the Sungai Gerong as the likely vessel. The satellite scene, captured at 22:33 UTC (Coordinated Universal Time), shows a slick that closely aligns to the AIS broadcasts from the Sungai Gerong.
You’ll probably notice that the tail-end of the slick is a bit contorted and offset from the track of the Sungai Gerong. The slick’s appearance was likely influenced by ocean currents and local weather conditions between the time of the ship’s passing and when the image was taken. Global wind maps show that there were 10-15 knot winds blowing northwest up to six hours before the image was acquired. This data suggests that wind likely impacted the slick’s appearance. As a result, we believe that the Sungai Gerong is the likely source of this slick.
Using AIS, we tracked the Sungai Gerong as it traveled north through the Sunda Strait — the body of water between the Indonesian islands of Java and Sumatra — to the port of Jakarta. Similar to the Strait of Malacca, the Sunda is an important waterway that connects the Indian Ocean to the Java Sea. Though not as dense with marine traffic as the Malacca Strait, the Sunda is still subjected to pollution from vessels.
We also recently identified two suspected bilge dumps in the Philippines (Figure 2). Occurring on July 6th in the South China Sea, a 238 kilometer long slick behind the vessel in this Sentinel-1 radar image looks like a bilge dump. The Philippine island of Palawan, a popular tourist destination for its beautiful natural landscape, appears on the right side of the map frame. Another smaller slick without a known source is visible to the left of the larger slick.
Using AIS broadcasts from ShipView, we identified the Ulaya, a Thai oil tanker, as a possible source of the slick. The last AIS broadcast from the Ulaya (seen directly above the ship) was transmitted fifteen minutes before the image was captured. These AIS broadcasts give us reason to believe that the Ulaya could be responsible for this slick. Moreover, ShipView shows that the vessel was headed towards the Port of Belawan in the Strait of Malacca with a shipment of Dangerous Goods. According to the International Maritime Organization, a United Nations agency that regulates global shipping, chemicals falling under this classification are “hazardous to marine environments.” Thus, a slick from this ship could be of greater concern than usual.
These examples show that bilge dumping continues to be a problem in the waters of southeast Asia. But with satellite imagery, anyone, anywhere can see what’s happening on the water and help to raise the alarm. We hope that our persistent and careful surveillance will inspire others to pressure policy makers, government regulators, and the shipping industry to take strong, coordinated action to stop bilge dumping.
“Well Kick” Causes Spill in Java Sea
/in Oceans, Oil & Gas, Oil Spill, Watchdog /by Brendan JarrellFollowing up on recent reports of oil in the water off the north coast of Karawang Regency, West Java, Indonesia, SkyTruth has picked up a slick in Sentinel-1 radar imagery. In the image from July 18th, an unidentified platform (circled in red) located roughly 12 km north of the Karawang shore is shown emitting a 34.7 km-long slick into the Java Sea. A story written by the local Jakarta Post on July 18th describes state-owned energy firm Pertamina’s decision to evacuate personnel and halt operations at an offshore production rig in their Offshore Northwest Java (ONWJ) block. The evacuation was ordered after a dangerous “well kick”, or unplanned release of gas caused by low pressure in a wellbore, initiated a large slick on the 16th of July. A separate report released by the Jakarta Post five days later indicated that the Indonesian Transportation Ministry teamed up with Pertamina in response to the oil-related event, along with several other smaller entities in the area. The response vessels were able to set up a boom around the perimeter of the offshore platform. Unfortunately, this didn’t stop oil from reaching villages and beaches on West Java’s coast. Given the fact that several vessels surround the unidentified object in the Sentinel-1 image, we believe that this could be the affected drilling platform. Pertamina’s upstream director Dharmawan Samsu estimated that it will take approximately eight weeks for the oil and gas leakage to be plugged.