Blog icon

By  Andrea Wild 15 March 2022 2 min read

The Brown Marmorated Stink Bug (BMSB) is a sap sucking bug native to China. It is a threat to crops such as apples, stone fruits, hazelnuts and grains.

BMSB looks similar to many other stink bug species, making it difficult to recognise.

We are working closely with biosecurity staff at the Department of Agriculture, Water and the Environment (DAWE) to help keep this pest out of Australia.

[Image appears of a black screen with text: Development of the BMSB AI app, Funded through the Biosecurity Innovation Programme, Department of Agriculture, Water and the Environment]

[Image changes to show a close view of five stink bugs in a small box, and text appears at the centre: Developing a BMSB App]

Dr Michael Elias: So, stink bugs are quite a diverse group in Australia.

[Image changes to show Dr Michael Elias pulling a drawer of bugs out of a cabinet and then the camera zooms in on the drawer of bugs]

There are about 600 different native species in Australia, and potentially thousands of species we haven’t discovered yet.

[Image changes to show Michael placing the tray onto a table, and then the camera zooms in on the bugs in the tray]

Generally speaking, they’re quite specialist so they’ll only eat one or two species of plants, and because they’ve evolved here they will only eat native species.

[Image changes to show Michael’s hand as he points to various bugs in the tray, and then the camera zooms in on some of the bugs]

There are a few which are more generalist and they tend to be the bigger pests.

[Image changes to show Michael talking to the camera, and text appears: Dr Michael Elias, Australian National Insect Collection]

But the biggest pests are the ones which come from overseas because they’re adapted to eat crops. Most of our crops come from somewhere else so they’re adapted to eat those crops and they have no natural predators.

[Image changes to show a very close view of the brown marmorated stink bug]

Brown marmorated stink bug is originally from east Asia, especially China, especially the wetter regions of China.

[Image changes to show Michael talking to the camera, and then the image changes to show an aerial view looking down on vineyards]

Because it’s such a generalist species it targets a very wide variety of crops, especially stone fruit, apples, pears, tree nuts – especially hazelnuts, it’s a big, big pest on hazelnuts – and wine grapes and there’s several other smaller crops as well.

[Image changes to show a person working in a vineyard, and then the image changes to show an aerial view looking down on a cargo ship, and the camera zooms out a little]

The way they deal with most pests when they find them at the border is they go out and they collect them.

[Camera pans over the cargo ship, and then the image changes to show a shipping container held on a crane]

Because they’re not trained entomologists they send them back to an entomology lab. In the meantime that cargo has to be held in quarantine at the expense of the importer.

[Image changes to show Michael talking to the camera]

If the biosecurity officers had a tool which they could use to identify on the spot, you wouldn’t need to spend that much time, which is a lot of money for the various importers.

[Image changes to show Dr Alexander Schmidt-Lebuhn sitting at a table looking at a stink bug in a box and talking to the camera, and text appears: Dr Alexander Schmidt-Lebuhn, CSIRO Scientist, Centre for Australian National Biodiversity Research]

Dr Alexander Schmidt-Lebuhn: This is the brown marmorated stink bug which is a major biosecurity threat for Australia. It’s a very generalist sap sucking insect that might cause immense damage to horticulture and agriculture if it establishes in Australia.

[Images move through to show a close view of trays of stink bugs, charts showing pictures of stink bugs, and then the camera zooms in on the trays of stink bugs again]

There are about 600 known Australian native species of stink bugs but there may be thousands of undescribed species too.

[Image changes to show Alexander talking to the camera]

The critical thing about invasive species is that they don’t have any natural enemies here so they may be able to do a lot more damage than the native ones that are actually controlled.

[Images move through to show camera equipment, and then the camera zooms in on the camera photographing a stink bug]

The present project is funded by the Department of Agriculture, Water and the Environment, through a biosecurity invasion programme.

[Images move through to show a photo of the stink bug on a computer screen, a researcher working on the computer looking at the stink bug photo, and then the camera equipment again]

We are creating an image recognition model that will allow inspectors and biosecurity officers to distinguish the brown marmorated stink bug and other potential pest species from closely related and similar native species.

[Images move through to show the camera equipment photographing the stink bug, a researcher working on the computer, and then a stink bug shown on a Smartphone screen]

That will allow them to make decisions about cleaning cargo, for example, about eradication actions, and will ultimately safeguard Australian, the Australian economy and agriculture.

[Camera zooms in on the Smartphone screen app showing the stink bug]

We have produced this AI model but to really make it useable to people we are putting it into a Smartphone app that the Department of Agriculture can then use at the border at ports to identify specimens in the future.

[Image changes to show Alexander talking to the camera]

I myself am an optimist, and actually the first model that we produced, and that we put into this prototype app here was a wheat seed identification model because I’d come out of the wheat seed identification project for the Department. And when we showed this to our partners at the Department of Agriculture, Water and Environment it turned out that yes the principle of this identification app was great but the actual really concrete problem at the moment were the stink bugs so that is where we then turned our attention next.

[Image continues to show Alexander talking to the camera and a female can be seen in the background working on the computer with the stink bug photo on the screen]

But ultimately an app like this can have all manner of identification models in it. We could have one in the future for moths, we could have one for wheat seeds again, we could have one for rust fungi, potentially anything that lends itself to being visually recognised by the expert can also then be visually recognised by the artificial intelligence.

[Image changes to show a black screen and credits and  appear at the bottom, and the Coat of Arms and text appears above: Australian Government, Department of Agriculture, Water and the Environment]

We are working with biosecurity officers at the Department of Agriculture, Fisheries and Forestry (formerly Department of Agriculture, Water and Environment) to develop an app to help correctly identify BMSB.

Share & embed this video

Link

https://vimeo.com/689543157

Copied!

Embed code

<iframe src="//player.vimeo.com/video/689543157" width="640" height="360" frameborder="0" allow="autoplay; fullscreen" allowfullscreen></iframe>

Copied!

An AI app for stink bugs

Our Australian National Insect Collection has thousands of specimens of expertly identified stink bugs species from Australia and overseas.

"We are taking detailed digital images of the stink bugs in our insect collection," our botanist Dr Alexander Schmidt-Lebuhn said.

"We're training Artificial Intelligence to recognise BMSB and tell it apart from similar looking species, especially native ones that are commonly found by biosecurity officers."

The result is an app that biosecurity officers are currently trialling at ports and airports. It uses the video feed of a smartphone.

"You hold the camera over the bug and can zoom in or out and look at it from different angles. The AI model in the app provides a constantly updated identification estimate and its degree of certainty," Alexander said.

The app also has species' profiles with example images and species information. Users can record a photo of the bug, its identification, and the geographic coordinates and local time.

We are using a 3D imaging system to take images of stink bugs from many angles to train the AI inside our app. This requires several hundred images per species.

A rapid spread around the world

Australian has about 600 named native stink bug species, as well as several thousand more undescribed species. They get their name from the smell of their pheromones, the chemicals they use to communicate.

Michael Elias is a taxonomist at our insect collection.

"BMSB began to spread in the mid-1990s when exports from China increased. It's now established in many countries around the world," Michael said.

"This is thanks to their biology. They gather in large numbers near bright lights to breed, then go into hibernation in dark, hidden places. If they breed near the bright lights of a car plant, the pregnant females can hide in the cars and wake months later in a new country, ready to cause an infestation.

"Unlike our native stink bugs, BMSB has no specialised natural enemies here to keep its populations in check," he said.

A man looking at pinned specimens in a lab.
The app shows how likely it is that the species identification is correct.

From daisies to stink bugs

Alexander is a botanist who researches the 25,000 different species in the daisy family.

"I got involved in biosecurity work because the daisy family has many weeds. This is because their seeds spread very easily," he said.

"We developed an app prototype for identifying the seeds of weedy daisies in collaboration with Microsoft. We’ve used what we learned there to develop our stink bug app.

“We hope to expand it in two different directions. Firstly, we want to add AI models for more types of biosecurity threats, beyond stink bugs. Secondly, we hope to involve the public in biosecurity work so that people can identify and report pests and weeds."

Contact us

Find out how we can help you and your business. Get in touch using the form below and our experts will get in contact soon!

CSIRO will handle your personal information in accordance with the Privacy Act 1988 (Cth) and our Privacy Policy.


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

First name must be filled in

Surname must be filled in

I am representing *

Please choose an option

Please provide a subject for the enquriy

0 / 100

We'll need to know what you want to contact us about so we can give you an answer

0 / 1900

You shouldn't be able to see this field. Please try again and leave the field blank.