Introduction #
A bespoke EMPS: Electron Microscopy Particle Segmentation dataset was constructed to serve as the training data for the authors’ work. It consists of 465 electron micrographs and their corresponding human-labeled ground-truth semantic instance segmentation maps, as well as the coordinates of the polygons drawn around each particle to construct these segmentation maps.
The figure shows 16 sample images and their segmentation maps and portrays qualitatively the diversity of particle sizes, shapes, textures, densities, and (grayscale) colors that exist in the dataset. Although not relevant for computing quantitative measures, the authors included several images where particles overlap each other with varying degrees of overlap, as this is common in the electron micrographs of nanoparticles. The third EM image in the second row of the figure above is an example of highly overlapping particles, while the particles in the fourth EM image of the third-row show minor overlap.
All images in the EMPS data set were mined from published scientific literature using the data-mining application programming interface (API) of Elsevier. Authors first used the Article Retrieval API to obtain the digital object identifiers (DOIs) of articles published between the years 2015 and 2020, which had the possibility of containing EM images. This was achieved using the search query “SEM−TEM−scanning electron microscopy−transmission electron microscopy.” Next, using the Object Retrieval API, authors iterated through the figures in these articles and obtained images at high resolution from any figure that contained one or more of the acronyms or phrases from their search query. This resulted in 34 091 images of figures, from which 788 were manually determined as suitable and set aside for postprocessing. It was often the case that EM images were part of a panel of several images in these figures. Thus, the EM images were cropped from these 788 figures, resulting in 962 potential images being labeled (many figures contained several relevant EM images). Authors annotated 465 of these images using the VGG Image Annotator (VIA). This consisted of drawing polygons around each individual particle in each image. Once the annotation process was completed, the authors finally assigned pixels to particle instances in each image by finding all pixels that were encapsulated by the polygon of each particle.
The figure presents some statistics of the images and particles in the EMPS dataset. It is evident that most images contain fewer particles, and only a few images contain many particles (on the left). Similarly, with particle sizes, most particles in the dataset are small, with the number of large particles dropping significantly as particle size increases (on the right).
Summary #
EMPS: Electron Microscopy Particle Segmentation is a dataset for instance segmentation, semantic segmentation, and object detection tasks. It is used in the materials research.
The dataset consists of 465 images with 11594 labeled objects belonging to 1 single class (particle).
Images in the EMPS dataset have pixel-level instance segmentation annotations. Due to the nature of the instance segmentation task, it can be automatically transformed into a semantic segmentation (only one mask for every class) or object detection (bounding boxes for every object) tasks. All images are labeled (i.e. with annotations). There are no pre-defined train/val/test splits in the dataset. Also, the dataset contains doi tag. The dataset was released in 2021 by the University of Cambridge.
![Dataset Poster](https://cdn.datasetninja.com/github/dataset-ninja/emps/main/visualizations/poster.png?width=1200)
Explore #
EMPS dataset has 465 images. Click on one of the examples below or open "Explore" tool anytime you need to view dataset images with annotations. This tool has extended visualization capabilities like zoom, translation, objects table, custom filters and more. Hover the mouse over the images to hide or show annotations.
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/A/n/Ly/IpOOE4Xn2uGk23SUZfrlBQisdAlNaWqLED8LjpdfcqPkZPUuTXCTcqtF2bhIao7P0oHp1tKuLAQRq3ka4v7ROb80ZkKnuH5O7DKdE3vLAhYknGn1PmmzmTr5JJIN.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/w/m/A8/tb1WNDz3Wr0FnAyMUQ4MAoJLzw8xkhZNvL6uo2Mr47eqS1cMGQIwP4Te33BfSn3YJc1nPetv9BakVqtRencqZCRVF2OKf6tZkYtsvERgJP1mHaKVzxqFeixayYEL.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/W/i/zH/3rmq6YWff6ggk78Wo1UArlzo310OezcLye1CliZ7BL0OodxLYWviKN1ezUGPupQYUAUy6hVV8Da3IVZawEdV9MxiWJC1Dgz9qnEgk9dx4XWi78wZAWoiizuovO87.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/0/h/D7/3tYUUrIMClZKjl56cEk1gZzbSrFMaKHY86gqYIKcqErYlVagjKHb1lEKNMs9jQFHzN8HqgoElsnWoZ48ebx54fy6c5IMbGVJmj4eqJcb22U8Ykrg5VR2hqslbYNw.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/I/6/qT/WFSniH6Z3g4YFJHJax32NCXQ5tCqrWMdZrLAjcPhlcbwTJwKgzXxh2WLMV9IJphiuwfEsWDQUe9HVxQbcWyQcsmdbp6XLraHJv1lfgVpSmUj0xj9z9IePgZK4frK.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/9/s/KS/uC4g7yrP7zwe7pAFuYNfqYka2mgTxPkIUpJeXkY7aC1Vkws9X0lv015EFhCQau9yy6mOLlreT5ghnEgc09R1MEanCfYKA8JA1iNpUDosoDP1BCQsJVLRNjICT1up.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/r/4/GE/E6HE6ifDMkU2gDciun58TkAE7omUdar1kw3xVDPRsJo8oLnhSROhnJpPzPmdmXjra8sTTmBLIb9BrHv4V4PUWYetnvAbrZDIf6ycMS9eEyaVhKkHRh7noTQ1qFSF.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/L/A/Mb/fPBy15gxgG7QiYuaooXFPxbHldHxlBkmYbmWykZXJz0x0Oazll44JswYqKi6EnxJgBsJRTEulyg9MA7NbKSmL4cD1N15wyzTlRCjS08TJs7ZVwBYa0P0oKDAH9FJ.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/K/I/K9/MdS1fzVOwXSNd1A8UEuei6hX80BPUFxNwDqUVVCi5qZDef93EdQhv3K99kAmReMCczIy4whVFHimoqNo4AXQCxRFuExAIDOFp429T0T80LKXp3QgvEqDIuaNDPCH.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/H/p/Hi/3xcU4yo0f04sCVlVM1shHHtayFH8R3DGPQvzTsRkgn3tYlQ16vMlLxlSlXsRnrcGrlVf9u2FypCTPkB7K0RgdyydsJ21QTKvUGZIKAxpIrjdodAgKjjCjqvuExLo.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/e/V/st/oNFvwdZUCWdDKNKjYHyv7aagfiQbJrgyokya3Ab0OeVEYa3P1OM4APs1czRrA5bg7lS0xiOnGx6wUpsP48O5i1QiLUbxkmvfEin7szhxMZUjamzKALWMby7Z4Cbu.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/x/O/No/XoBSBNfDOEM4GfL4bQ0iK6P8Pq6WxzbVxggl0hz3pXqdUyPEj6Wwv1m5f2F1PGbke16Uq2gvABHv3WUWJxXCvegbUXZZG38v78dX2AWIsBhX7nXLTm52XrsGGke2.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/3/U/ks/3SxeThFlNc7sWuOOFpV09tdVvEsZw4dKsgzX9mR0lkU5ezDkIDoA70aDVUtar9bZXzfie9uMzH2WMfrqQqhhNoF1fQJd3F2LTD2wUUgZr8WtILOheIq3AUsHf8Cr.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/L/j/ck/eQW1KXIIZU2Eb6MCKQZYRi5w8HJQY39nS0nAOuvAh3OkwhizNzaRnla5cZ3DnKuonSoCGpsnWnEvmy3qWhBlLLJDqHU7ab4x8tlIGW38u7dhSJLfzjb7ukiJsWu6.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/c/S/2c/c5d7UbLdslFRX3ChY5HEvPWajcvxB8VfyOOyigQ5UUEFbwt0VTz91mmJ2HDU9k1r8ICyNTA7lPKnF1w6gEz1DH7rp7CRn1A5WTwlEZnueCxtd23XDi6NEOcUgAvs.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/u/K/4W/3FbET6LY3yQFUMVUi4bUDoo4R8AsNUc127dxh5l2aB0UzdI21McfDw45XRAFrzgvfNI390EpOKTIkhtlPiDXubjPVziZwVVKZPswGj9q0psdd1p19iynnm5FVSwO.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/C/5/fi/E5b5KgK5FW0B6JVYyHuvGWF9aybReB0vrEGy3sgwJdlpELoMy2WEC9ZtvGFjvYibbcICGifZNvsLVcFZrayauUySn0b8D09BFUGbhIfUmcZILnLlGGdnvsI5sw3I.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/7/v/3B/Y9TL3QXPeMQCtMOeRwUDuJWTE7iM6r9TJObzNbtTbmj1qUDwd0woYcFQEBPoXk9tTydBOVbea588BYIgYHEHeOSlzOUbrY0RQmbrN1Y0NH0YciuoAtvn58eocrRI.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/p/q/OR/h52GciLXAyWgurgBxhrRLoTGylRpsBTmhxq7USf4xBp8CB9yb1hG1LXGn3J4ysvtfTDLNTda35hKi1PqID4pI8SoUN6VhnvizqkTxgg26zRQVkGUF62JGWbZoJwm.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/z/Y/c2/5uqfRdqEA073JycW3rbfn1gCBPHKchoMc1ktX06ccBqGjqgJQIlFO8FgcQWg6ZKmQEqXoixIbY1RfgS5lYFH2eYO5AKZuYVXzKomIpCW33q9dyDOFHdzOIYIu0Fy.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/T/k/WM/lqKsGxsUbMp5dir8xoZsPBGv0AC7yfFzDQ3ffnDXhcyiczzO1k4djgmgbJ0WCMitMxoN2uk6CR86Qph0FBXDVZStJb35w9ifNmBcOKfpXuPtEQ6CQmXENB0oaDpq.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/z/M/Pe/tLXG95NyFf9jR7VJJu5wWWRodonI4zK4fLgTxAOMX2cZKJMyW6a70mt52J03jYUsgqyCb7jYQ8xjrS9mbbTcyAFxjKDPUrtv2DRAECjrAvD0UcjiZPPkigjo9vgw.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/M/U/y5/2eXAEVy38YKtOrCZmqPTUMj2MsioDgMjrJf0I5aFPnvoKEy6YTw8HSQFN2etOhGQmNgqqnPxp0mmbZHhpDnjZS7qFz4kQOUd6ijzBULLNu5tY1oSKpEka1ohVQu5.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/B/8/vr/4A61u9cQKvWhXBBkH1flGphZ53BaXQh1gDiyReklqhBz6AD01zvprGLaiFqBev6vEHbZAyim96toV6QIKQ2DUbBjehCjQjuMhntYNBEYH0VVdpexnCfoUgiuMXTL.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/z/L/GS/vvgbWtqoZjyGOpDIY2SfjDHHk0kt3SNx7wRuWbslBIRtZORCpWWAMmXx0i03KPnKKNA4BlV0T0nnJiL2TFZsB77fIjxOrXOTcas7vxHHjIef4IzeiavJXgw08qcP.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/g/U/8s/iJnTheeQutmAiMn0GsTT980kOcsyrksC9ipJvadoLLCjRvj2FgItpx2eRXht42NY8wp35J7ljct0Uyddgpag0wFS8McQBRwdgnxxwFwe0ivBzKZGZzJw7UmjJTYP.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/L/a/Yf/dW2WdD8ryn9fOFTSRtPeVzVTk6vJArfZOpodeRDjVkBGUFXbJ6fXEfaPCriujpyGz7CkIm7orGXQFg3wGYjgXllIx7GsXKdZPXqS5QKy3x51WTqgb4UcXejTBsSd.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/V/B/qb/YF6Y9vGv7DXJTQQ0RCO4hvSJWHwcYyDspuwjNDHO9M93yNB9UGLxlFBgahNiI00DHqlXOCZU2fO1PUkY20rLwYy4olUaObdOIxrWAP08TAQkZq5is1LerEfAVq0c.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/8/g/jp/Ww1x6OaiZwH6M7jdmreuNWJ2sxDl4KWtEyewzEFxbpbQXestkaYeKCuVOyf5uBxPyMf8m8hO0Fxs49eW7VBxI6U5pzuVgpc1MV67l9fp57aH19tlAMlQRox9A8CN.png)
![Sample image from EMPS](https://cdn.datasetninja.com/previews/q/ext:jpeg/resize:fill:400:0:0/q:70/plain/supervisely-supervisely-assets-public/images/original/9/X/1r/3Snk9PPI1tgoCnDnVNYwRZgn6tCHUNqcUviUiLLwV1aHUcEyEjvOws7cOCOOHdxm3FpXCqRz6EdSo3oek9s9P3kuK6HoHLaIPekPO7d6F4cyOqNs0wF68oysPjS4.png)
Class balance #
There are 1 annotation classes in the dataset. Find the general statistics and balances for every class in the table below. Click any row to preview images that have labels of the selected class. Sort by column to find the most rare or prevalent classes.
Class ㅤ | Images ㅤ | Objects ㅤ | Count on image average | Area on image average |
---|---|---|---|---|
particle➔ mask | 465 | 11594 | 24.93 | 33.47% |
Images #
Explore every single image in the dataset with respect to the number of annotations of each class it has. Click a row to preview selected image. Sort by any column to find anomalies and edge cases. Use horizontal scroll if the table has many columns for a large number of classes in the dataset.
Class sizes #
The table below gives various size properties of objects for every class. Click a row to see the image with annotations of the selected class. Sort columns to find classes with the smallest or largest objects or understand the size differences between classes.
Class | Object count | Avg area | Max area | Min area | Min height | Min height | Max height | Max height | Avg height | Avg height | Min width | Min width | Max width | Max width |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
particle mask | 11594 | 1.34% | 76.75% | 0% | 1px | 0.2% | 578px | 100% | 57px | 11.04% | 2px | 0.29% | 1022px | 100% |
Spatial Heatmap #
The heatmaps below give the spatial distributions of all objects for every class. These visualizations provide insights into the most probable and rare object locations on the image. It helps analyze objects' placements in a dataset.
![Spatial Heatmap](https://cdn.datasetninja.com/github/dataset-ninja/emps/main/stats/classes_heatmaps.png)
Objects #
Table contains all 11594 objects. Click a row to preview an image with annotations, and use search or pagination to navigate. Sort columns to find outliers in the dataset.
Object ID ㅤ | Class ㅤ | Image name click row to open | Image size height x width | Height ㅤ | Height ㅤ | Width ㅤ | Width ㅤ | Area ㅤ |
---|---|---|---|---|---|---|---|---|
1➔ | particle mask | 22c776b059.png | 512 x 734 | 91px | 17.77% | 125px | 17.03% | 1.46% |
2➔ | particle mask | 22c776b059.png | 512 x 734 | 135px | 26.37% | 200px | 27.25% | 1.56% |
3➔ | particle mask | 22c776b059.png | 512 x 734 | 90px | 17.58% | 41px | 5.59% | 0.6% |
4➔ | particle mask | 22c776b059.png | 512 x 734 | 79px | 15.43% | 132px | 17.98% | 1.04% |
5➔ | particle mask | 22c776b059.png | 512 x 734 | 131px | 25.59% | 24px | 3.27% | 0.59% |
6➔ | particle mask | 22c776b059.png | 512 x 734 | 182px | 35.55% | 130px | 17.71% | 1.64% |
7➔ | particle mask | 22c776b059.png | 512 x 734 | 128px | 25% | 261px | 35.56% | 3.8% |
8➔ | particle mask | 22c776b059.png | 512 x 734 | 257px | 50.2% | 122px | 16.62% | 4.68% |
9➔ | particle mask | 22c776b059.png | 512 x 734 | 39px | 7.62% | 63px | 8.58% | 0.41% |
10➔ | particle mask | 22c776b059.png | 512 x 734 | 217px | 42.38% | 202px | 27.52% | 8.5% |
License #
Citation #
If you make use of the EMPS data, please cite the following reference:
@article{doi:10.1021/acs.jcim.0c01455,
author = {Yildirim, Batuhan and Cole, Jacqueline M.},
title = {Bayesian Particle Instance Segmentation for Electron Microscopy Image Quantification},
journal = {Journal of Chemical Information and Modeling},
volume = {61},
number = {3},
pages = {1136-1149},
year = {2021},
doi = {10.1021/acs.jcim.0c01455},
note ={PMID: 33682402},
URL = {https://doi.org/10.1021/acs.jcim.0c01455},
eprint = {https://doi.org/10.1021/acs.jcim.0c01455}
}
If you are happy with Dataset Ninja and use provided visualizations and tools in your work, please cite us:
@misc{ visualization-tools-for-emps-dataset,
title = { Visualization Tools for EMPS Dataset },
type = { Computer Vision Tools },
author = { Dataset Ninja },
howpublished = { \url{ https://datasetninja.com/emps } },
url = { https://datasetninja.com/emps },
journal = { Dataset Ninja },
publisher = { Dataset Ninja },
year = { 2024 },
month = { sep },
note = { visited on 2024-09-08 },
}
Download #
Dataset EMPS can be downloaded in Supervisely format:
As an alternative, it can be downloaded with dataset-tools package:
pip install --upgrade dataset-tools
… using following python code:
import dataset_tools as dtools
dtools.download(dataset='EMPS', dst_dir='~/dataset-ninja/')
Make sure not to overlook the python code example available on the Supervisely Developer Portal. It will give you a clear idea of how to effortlessly work with the downloaded dataset.
Disclaimer #
Our gal from the legal dep told us we need to post this:
Dataset Ninja provides visualizations and statistics for some datasets that can be found online and can be downloaded by general audience. Dataset Ninja is not a dataset hosting platform and can only be used for informational purposes. The platform does not claim any rights for the original content, including images, videos, annotations and descriptions. Joint publishing is prohibited.
You take full responsibility when you use datasets presented at Dataset Ninja, as well as other information, including visualizations and statistics we provide. You are in charge of compliance with any dataset license and all other permissions. You are required to navigate datasets homepage and make sure that you can use it. In case of any questions, get in touch with us at hello@datasetninja.com.