Start Here

Using MERMAID Collect

Using MERMAID Explore

Using MERMAID R Package

Importing CoralNet Data with Easy PQT

MERMAID Easy PQT is a user-friendly Shiny app designed to help you import photo benthic quadrat data annotated in CoralNet into MERMAID—without requiring any coding in R.

If you're not comfortable using the MERMAID R package mermaidr, Easy PQT is an excellent alternative. It streamlines the process and guides you through each step, ensuring your data is correctly formatted and imported.

Before using MERMAID Easy PQT, you’ll need a verified MERMAID account. See Getting Started.

Note: With MERMAID Easy PQT, only project admins can import data into projects in MERMAID Collect, and also test projects won’t appear in the projects’ list. 

Easy PQT workflow
Easy PQT workflow

Step 1: Prepare Your Project in MERMAID Collect

Before importing data, your project needs to be set up in MERMAID Collect:

  • Set up a new project (or check that you have an existing project ready for the data import):

    • Add your organization(s).

    • Add users and assign their roles.

    • Set data sharing policies.

    • Add sites and management regimes associated with the data you are importing. 

Read more in Setting Up a Project.

Step 2: Export Data from CoralNet

To export data from CoralNet:
  • Navigate to your CoralNet project > Images > Image Actions > Export Annotations, CSV.

  • Select the label format Both.

  • Include optional columns: Image metadata – date and auxiliary fields.

  • Make sure auxiliary fields include: Site, Management regime, and Transect number (names can be customized). If you haven’t use the auxiliary fields, you need to set it up in your CoralNet project (more info on how to add auxiliary fields can be found in the Calcification Metrics in CoralNet help page under the Different Table for Different Images section.

Export your CoralNet annotations as a CSV file, making sure to include labels (both short codes and ID numbers) and auxiliary fields like site, management regime, and transect number.

Step 3: Open MERMAID Easy PQT

  • Navigate to the MERMAID Easy PQT

  • Easy PQT will prompt you to authenticate using your MERMAID credentials.

  • Under MERMAID Project, a list of your non-test projects will be displayed. Choose which project to import your CoralNet data to.

Note: Only projects not marked as test will appear in the Select a project dropdown.

Authenticate with MERMAID and select a project to import data into.

Step 4: Upload CoralNet CSV File

  • Upload your CoralNet CSV file by clicking Browse or drag and drop your file into the upload modal. Easy PQT will automatically read your file.

Upload your exported CoralNet CSV file or ReefCloud ZIP file into MERMAID Easy PQT.

Step 5: Match Auxiliary Fields

  • Match your CSV’s auxiliary columns with Site, Management, and Transect values in your MERMAID project.

  • Easy PQT will validate your entries and highlight any mismatches with guidance.

Match your CoralNet CSV’s auxiliary fields to existing MERMAID metadata. Errors or mismatches will be highlighted.

Step 6: Assign CoralNet Labels to MERMAID Benthic Attributes

  • MERMAID Easy PQT automatically assigns CoralNet labels to MERMAID benthic attributes and/or growth forms.

  • Any unassigned values appear in red at the top of the table. Click and type or use dropdowns to assign the correct benthic attribute and/or growth form.

Note: You can leave the MERMAID Growth form column empty, but the MERMAID Benthic attribute is a required field.

Once all of your labels are assigned and reviewed to valid MERMAID benthic attributes, you can click the Confirm button to continue the importing process.

Review and adjust labels assigned to ensure all CoralNet labels correspond to valid MERMAID benthic attributes and/or growth forms.

Step 7: Review and Import Data into MERMAID

  • Once your data is reshaped and validated, click Import data.

  • Alternatively, you can restart by clicking on the Restart Easy PQT button or get help by clicking on the Get Help button if something doesn't look right.

  • You can also download the reshaped dataset as a CSV by clicking the Download reshaped data button on the top right of the table.

  • Once the importing process is complete, you’ll receive a confirmation message on your screen: Import successful! 

  • You can either close the window or scroll to the bottom and click on Go to MERMAID Collect to finalize the import process in MERMAID Collect. 

Double-check your data before finalizing then continue with the import process into MERMAID.

Step 8: Complete Sample Units in MERMAID Collect

  • Go to your Collecting page in your project.

  • Complete required fields: depth, transect length, and quadrat size.

  • Verify observer info. MERMAID will automatically assign you as the observer. You can change the observer if someone else collected the data.

Once import is completed, your data is accessible as sample units in your Collecting page. Complete required metadata and submit your validated sample units.
  • Validate each individual sample unit.

  • Submit each validated sample unit.

  • Once submitted, sample units become available to all project’s users in the Submitted page. 

Note: Imported data appears under your account in your personal Collecting page of the assigned project. If needed, a project Admin can transfer all sample units to another user via the project’s Users page. Read more about transferring sample units in Editing Data.

Do You Prefer a Code-Based Workflow in R?

For R users, see Importing Legacy Data into MERMAID.

Learning About Our Taxonomic Reference

MERMAID provides a centralized and standardized reference for all reef fish species and benthic attributes used in data collection and analysis. These references are validated against authoritative sources to ensure taxonomic accuracy and analytical consistency across the platform.

Taxonomic Authority and Source Integration

MERMAID maintains scientific accuracy by relying on the following authoritative databases:

  • World Register of Marine Species (WoRMS)
    All fish and benthic species names in MERMAID are checked against WoRMS to ensure they are taxonomically valid and accepted. This reduces duplication and ensures naming consistency across projects. MERMAID also uses WoRMS to retrieve geographic distributions for all benthic attributes and reef fish.

  • FishBase
    For reef fish species, MERMAID automatically retrieves and regularly updates key ecological and biological attributes from FishBase, including:

    • Geographic distribution (combined with information from WoRMS)

    • Maximum length (as total length)

    • Trophic level

    • Vulnerability to fishing

    • Climate vulnerability score

    • Length-weight coefficients (a and b) used to calculate biomass using a Bayesian length-weight model

Download Our Taxonomic Reference File

You can access the full reference list directly in MERMAID Collect, even when offline:

  1. Open MERMAID Collect.

  2. Click Reference in the top-right toolbar.

  3. This will automatically download an XLSX file with the most up-to-date taxonomic references for fish and benthic attributes in MERMAID. 

MERMAID’s taxonomic references are updated regularly. To ensure accuracy, always download the latest version before use.

Download the latest benthic and fish reference file from the MERMAID Collect toolbar.
What’s Inside the Reference File

The reference file contains 5 worksheets:

  • Fish Families

  • Fish Genera

  • Fish Species

  • Fish Groupings

  • Benthic

Each sheet provides a standardized, filterable list of valid taxonomic entries and their metadata. These lists are used across MERMAID Collect, Explore, and R package.

Explore reference lists for all valid fish and benthic taxa in MERMAID.
Tips for Using the Reference File

Use Excel filters in the Parent column:

  • Select (Blanks) to view only top-level categories

  • Select a specific parent (e.g., Acropora) to view all related attributes

Filter for top-level benthic categories by selecting “(Empty)” in the Parent column.
View all benthic attributes grouped under a selected parent genus or category in the Parent column.

Proposing New Benthic Attributes or Fish Species

The MERMAID taxonomic reference list is continuously expanding, thanks to contributions from users across the community. When users enter observations in MERMAID Collect, they can propose new benthic attributes or fish species that are not yet in the system. 

Every proposal is reviewed by the MERMAID team, who verify the name against authoritative databases like WoRMS (for taxonomy) and FishBase (for fish traits and ecological data). Once approved, new entries are added to the reference database and become available to all MERMAID users.

If you notice a species or attribute that’s missing, cross check with the WoRMS database to ensure you’re using the accepted scientific name. If the accepted scientific name is not available in MERMAID, you can easily propose it while adding your data.

Learn how to do this in Adding a Sample Unit to Collect Data.

You can propose missing taxa directly in MERMAID Collect—just follow a few simple steps. Each suggestion is reviewed before becoming part of the MERMAID reference database. Please cross check with the WoRMS database before proposing to ensure that you’re using the accepted scientific name.

Standard Taxonomic Hierarchies in MERMAID

MERMAID uses a unified hierarchy structure for fish and benthic data across all tools—Collect, Explore, and the R package mermaidr. This ensures taxonomic consistency, reduces data cleaning, and enables reproducible analysis workflows.

Fish Hierarchy

MERMAID rolls up reef fish observations using the following structure:

Species → Genus → Family → Trophic Group
e.g., Acanthurus achilles (species)→ Acanthurus (genus) Acanthuridae (family) Herbivore (trophic group)

  • Trophic groupings (e.g., planktivores, piscivores, herbivores) are used for functional diversity and fisheries impact analyses.

  • When only genus or family is reported, MERMAID uses genus/family-level values from FishBase to compute averaged constants (e.g., for biomass estimation).

Benthic Hierarchy

MERMAID uses a similar structure for benthic attributes:

Species → Genus → Family → Top-Level Category
e.g., Acropora palmata (species) → Acropora (genus) → Acroporidae (family) → Hard coral (top-level category)

The 12 top-level benthic categories used in MERMAID are:

  1. Bare substrate

  1. Other invertebrates

  1. Crustose coralline algae

  1. Rubble

  1. Cyanobacteria

  1. Sand

  1. Hard coral

  1. Seagrass

  1. Macroalgae

  1. Soft coral

  1. Other (e.g., trash)

  1. Turf algae (including dead coral)

These categories are used to calculate benthic cover composition across sites and projects.

Why This Matters for Your Data

These hierarchies are essential for calculating key reef health metrics such as:

  • Benthic percent cover

  • Fish biomass (kg/ha) by family and trophic group

By automatically grouping observations from species to broader ecological categories, MERMAID allows users to generate these metrics even when observations are reported at different taxonomic levels (e.g., genus or family instead of species).

MERMAID’s hierarchical taxonomy supports consistent roll-up from species-level observations to broader ecological groupings.

Summary

  • All fish and benthic taxonomy in MERMAID is validated through WoRMS.

  • Fish data are dynamically retrieved from FishBase, including biomass and ecological traits.

  • Propose new species or attributes easily in-app, with validation support.

  • Use the reference file to explore, filter, and better understand taxonomic groupings.

  • MERMAID’s standardized taxonomy structure simplifies analysis and supports reproducible science.

Learning About Our Reef Health Metrics

MERMAID automatically calculates commonly used reef health metrics that are widely used in coral reef science and management. These metrics summarize your raw field observations into reef fish biomass, percent benthic cover, bleaching severity, and habitat complexity. They are available in MERMAID Collect, MERMAID Explore, as well as in the export XLSX files, and programmatically via the MERMAID R package.

Understanding the MERMAID Data Hierarchy

All metrics in MERMAID are structured into three levels:

  • Observation: Individual records (e.g., each fish count for a size class or benthic point). This is your raw data

  • Sample Unit: One transect or survey effort (e.g., one fish belt transect)

  • Sample Event: A site-level aggregation on a given survey date (e.g., all transects in a site on a specific date)

MERMAID summarizes raw data progressively from observation to transect (sample unit) to site-date level (sample event).

Accessing Observations and Summary Data

Once your data is entered, validated, and submitted in MERMAID Collect, you can export it as a zipped XLSX file. This export file includes separate worksheets for:

  • Observation data (e.g., individual fish or benthic records)

  • Sample unit summary (e.g., averages from each transect)

  • Sample event summary (e.g., site-level averages for a survey date)

You can also access the same data using the mermaid_get_my_projects_data() function in the MERMAID R package mermaidr. Read more in Accessing Project Data

Fish Abundance and Biomass

MERMAID calculates both total fish abundance and biomass. Abundance is calculated by summing the count of fish observed for each sample unit. Biomass is calculated using formulas based on FishBase Bayesian length-weight coefficients. MERMAID calculates:

  • Total biomass (kg/ha) and abundance (individu) for each sample unit

  • Average biomass (kg/ha) means and standard deviations by:

    • Sample event

    • Trophic group (e.g., piscivores, planktivores, herbivores)

    • Fish family (e.g., Scaridae, Acanthuridae)

Biomass Calculation:

MERMAID calculates biomass using the following steps:

  1. Fish biomass (kg/ha) per observation

  1. Total fish biomass (kg/ha) per sample unit by family, and trophic group

  1. Average biomass (kg/ha) per sample event by family, and trophic group. Standard deviations are also included

Benthic Cover

MERMAID supports three benthic methods:

  • Benthic Point Intercept Transect (PIT)

  • Benthic Line Intercept Transect (LIT)

  • Benthic Photo Quadrat Transect 

All benthic observations roll up into 12 top-level benthic categories (e.g., hard coral, macroalgae, soft coral). 

Percent Cover Calculation:

For each method, MERMAID calculates percent cover using the following formulas:

MERMAID also calculates means and standard deviations per category at the sample event level.

As observations are entered, MERMAID calculates benthic percent cover in a benthic sample unit, even offline.

Bleaching Severity

MERMAID includes a rapid bleaching assessment using quadrats, with bleaching categorized into seven severity categories. Data are entered into two tables:

Colonies Bleached Calculation:

MERMAID calculates the percentage of colonies in each of the seven bleaching severity categories (i.e., normal, pale, 0-20% bleached, 21-50% bleached, 51-80% bleached, 81-100% bleached, and recently dead) per sample unit:

  1. Average percentage of colonies for each bleaching category per sample unit

  1. Average percentage of colonies for each bleaching category per sample event. Standard deviations for sample events are also included 

Percent Cover Calculation:

MERMAID calculates the average percent cover of hard coral, macroalgae, and soft coral per sample unit and sample event:

  1. Average percentage of hard coral, macroalgae, and soft coral per sample unit. Standard deviations are also included

  1. Average percentage of hard coral, macroalgae, and soft coral per sample event. Standard deviations are also included

As observations are entered, MERMAID calculates benthic percent cover in a bleaching sample unit, even offline.

Habitat Complexity

MERMAID uses the Wilson et al. (2007) method for reef habitat complexity, with scores ranging from 0 (no complexity) to 5 (high complexity).

Average Score Calculation:
  1. Average score per sample unit. Standard deviations are also included

  1. Average score per sample event. Standard deviations are also included

As observations are entered, MERMAID calculates average habitat complexity score in a habitat complexity sample unit, even offline.

Want to Dive Deeper?

For more on how MERMAID generates these metrics, including calculations and taxonomies:

Citing Data from MERMAID

Properly citing data is essential, especially when using datasets from projects you are not directly involved with. Correct citation ensures appropriate credit to data collectors and supports data transparency and reproducibility.

Project Citation in MERMAID Collect

MERMAID automatically generates a suggested citation for each project. You can find this citation on the Project Info page within the MERMAID Collect. It is also included in all exported data files and displayed in the Metadata section of a site view in MERMAID Explore.

Key Points:

  • By default only project admins are added to the citation. 

  • The suggested citation can be customized to fit your preferred citation style.

  • Only project admins have permission to edit the suggested citation.

View and edit your project's suggested citation from the Project Info page in MERMAID Collect.
Citation Format 

All suggested citations generated in MERMAID follow the same following format: 

[Projects admins]. [Date of last update in project]. [Project name]. MERMAID. [URL to project view in MERMAID Explore]. 

How to Access and Edit the Citation
  1. Go to the Project Info page inside your project.

  2. Click the Edit Citation button to open the editable citation modal.

  3. Modify the citation text as needed in the Edit Citation field.

  4. When finished, click Update Citation to save your changes.

Admins can update the suggested citation directly from the Project Info page.
Revert Changes
  • If you want to revert to MERMAID’s original suggested citation after making edits, click the Use Default Citation button located at the upper right of the Edit Citation field.

  • Remember to click Update Citation after reverting to ensure your choice is saved.

Click “Use Default Citation” to restore MERMAID’s automatically generated citation.

Viewing Project Citation in Exported Data Files

The project’s suggested citation is always included in the data files exported from MERMAID. In each exported file—whether in the Sample Events, Sample Units, or Observations tabs—you will find a column labeled Suggested citation containing the current project citation.

This inclusion guarantees that anyone using exported data has clear guidance on how to properly cite the dataset.

The suggested citation is included in all export tabs to ensure users have proper citation guidance.

Viewing Project Citation in MERMAID Explore

Users can also view the project’s suggested citation while exploring survey data in MERMAID Explore:

  1. Navigate to the Survey Site you want to view.

  2. Open the Metadata tab within the site view on the right metrics panel.

  3. Scroll to the bottom of the Metadata section to find the Suggested Citation area.

  4. The citation displayed here reflects the current project citation, as set on the Project Info page in MERMAID Collect.

This feature ensures that users accessing data through MERMAID Explore can easily reference the project’s citation for proper acknowledgment.

The suggested citation for each project is visible in the Metadata tab when viewing a survey site, helping users properly credit the original data source.

Getting Data from MERMAID (via API)

MERMAID provides programmatic access to its entire dataset via an Application Programming Interface (API). This API is the backbone of all MERMAID tools—including MERMAID Collect, MERMAID Explore, and the MERMAID R package mermaidr—and can also be used directly for building custom tools, dashboards, or workflows.

This documentation refers specifically to the production API hosted at: https://api.datamermaid.org/v1/

The API is built on a secure, scalable AWS-based stack, powered by a PostgreSQL database (via Amazon RDS) and developed using Django and the Django REST Framework.

It is actively used by:

All MERMAID code is free and open source, licensed to support transparency, reproducibility, and community-driven development.

Why use the API?

Use the MERMAID API if you want to:

  • Automate data exports and processing.

  • Access real-time, up-to-date MERMAID data without manual exports.

  • Build your own custom visualizations or apps using MERMAID data.

  • Integrate MERMAID data into third-party software (e.g., ArcGIS, R Shiny, Tableau)

Explore the API Docs

You can find a detailed API documentation, which includes:

  • A client file guide using Insomnia to test requests

  • Instructions for authentication using MERMAID login credentials

  • Resources to browse endpoints

Authentication

All API requests require authentication. You can either:

  • Use your MERMAID credentials to obtain a token

  • Or generate an API token (if available to your user type)

Common Endpoints for MERMAID Projects 

Here are some frequently used endpoints related to MERMAID projects:

  • Observations: All observation in a transect for each survey method:

/projects/<project_id>/obstransectbeltfishs/

/projects/<project_id>/obsbenthiclits/

/projects/<project_id>/obsbenthicpits/

/projects/<project_id>/obscoloniesbleached/

/projects/<project_id>/obsquadratbenthicpercent/

/projects/<project_id>/obshabitatcomplexities/

  • Sample units: Aggregated metrics at the transect-level for each survey type:

/projects/<project_id>fishbelttransects

/projects/<project_id>/benthictransects/

/projects/<project_id>/quadratcollections/

  • Sample events: Aggregated metrics at the site/date-level for all survey types: 

/projects/<project_id>/sampleevents/

Integration Examples

You can use the API in tools such as:

  • R: via httr, jsonlite, or mermaidr

  • Python: using requests or pandas

  • Web apps: JavaScript fetch() or client-side libraries

Learn from Our Users

How Rare Automates Data from MERMAID to Their Dashboard

A standout example of how the MERMAID API is being used comes from Rare, which built an automated pipeline to extract coral reef monitoring data from its Fish Forever projects in MERMAID and feed it directly into their internal dashboard for streamlined analysis and reporting.

What it does:

  • Extracts data from the MERMAID API for projects tagged with “Rare,” including fish, coral, and photo quadrat data.

  • Transforms raw data into standardized formats using Python and Pandas, with full data validation.

  • Loads processed data into a PostgreSQL database, enabling real-time analytics and dashboarding.

Technologies used:

  • Apache Airflow: for robust, scheduled orchestration (daily at 2 AM)

  • Python with Pandas: for data transformation

  • SQLAlchemy: for secure and efficient database communication

Benefits:

  • Eliminates manual data downloads and prep

  • Keeps data fresh and analysis-ready with daily updates

  • Ensures consistency, error handling, and logging across projects

  • Scales across multiple projects and supports parallel processing

This pipeline is a powerful demonstration of how MERMAID’s API can be used to support data workflows. 

This pipeline is available on GitHub, allowing other organizations to adopt or customize it for their own needs.

Related Resources

Need help getting started? Contact the MERMAID support team or explore the API docs to learn more.

Global Fund for Coral Reefs in MERMAID

MERMAID has been chosen as the digital tool to facilitate the monitoring and evaluation of the Global Fund for Coral Reefs (GFCR) Programmes.