Bulk export agent-based policies and vulnerabilities with the API
Copy link

Overview
Copy link

Using the Bulk Export API, you can bulk export your agent-based policies, asset, vulnerabilities and asset, or vulnerabilty remediation data using a GraphQL API. The data is returned in Parquet  format and can be downloaded for use in your business intelligence tools.

To bulk export API data to Parquet files, complete the following tasks:

  1. Gather the information required to make a request
  2. Make a request
  3. Check the status of the export
  4. Download the files

Task 1: Gather required information
Copy link

To sucessfully run a Bulk Export request, you will need multiple pieces of information:

  1. An API key to authorize the request
  2. The relevant URI for your region
  3. The mutation for the data you want to export

As you complete task 1, copy the information you get somewhere safe for use in task 2.

Gain authorization
Copy link

⚠️

Permissions

You need an Organization API key or a user API key with Platform Administrator permissions to use the Bulk Export API.

Authorization is performed by passing your API key using the X-Api-Key header parameter. The API key must be passed with all requests. To learn how to generate and manage API keys, see Managing Platform API Keys .

Select your region
Copy link

Select the URI that matches the region associated with the API key you obtained for authorization.

RegionURI
United States - 1https://us.api.insight.rapid7.com/export/graphql 
United States - 2https://us2.api.insight.rapid7.com/export/graphql 
United States - 3https://us3.api.insight.rapid7.com/export/graphql 
Europehttps://eu.api.insight.rapid7.com/export/graphql 
Canadahttps://ca.api.insight.rapid7.com/export/graphql 
Australiahttps://au.api.insight.rapid7.com/export/graphql 
Japanhttps://ap.api.insight.rapid7.com/export/graphql 

Select export type
Copy link

Select a mutation based on the data you require:

Agent-based policy and all assets

mutation CreatePolicyExport { createPolicyExport(input:{}) { id } }

All vulnerabilities and all assets

mutation CreateVulnerabilityExport { createVulnerabilityExport(input:{}) { id } }

Vulnerability remediations

mutation CreateVulnerabilityRemediationExport($input: VulnerabilityRemediationExportConfiguration!) { createVulnerabilityRemediationExport(input: $input) { id } }

Additionally for this request, you must specify a date range, replacing startDate and endDate with date ranges from August 2025 onwards. startDate and endDate must not be the same date.

⚠️

Date limitations

For this additional variable, startDate and endDate:

  • Must not be the same date
  • Must not be further than 31 days apart
{ "input": { "startDate": "2025-08-03", "endDate": "2025-08-24" } }

Task 2: Make a request
Copy link

ℹ️

This guide shows how to complete this procedure using Postman.

You can use any GraphQL API client, but the steps outlined here are specific to Postman. All information from task 1 will be the same regardless of the tool you use.

Now that you have the required information from task 1, you can make a request to retrieve the URLs to download Parquet files.

⚠️

Export considerations

The data is refreshed by the system once a day. You can make multiple export requests, however overuse of this method may result in throttling.

To make a request:

  1. In Postman, click the three dots beside the relevant Collection and select Add Request.
  2. Change the query to POST using the dropdown in the query bar.
  3. Paste the region URI from task 1.
  4. Go to the Headers tab.
    1. Paste X-Api-Key into the Key column.
    2. Paste the API key from task 1 into the Value column.
  5. Go to the Body tab.
    1. Select GraphQL from the options at the top of the tab.
    2. In the Query section, paste the mutation you selected in task 1.
  6. Click Send in the query bar. This will begin to run the request.
  7. Under Body you will see a response, where EXAMPLEID will be a unique string:
{ "data": { "createvulnerabilityExport": { "id" : "EXAMPLEID" } } }

Copy this ID and keep it somewhere safe for use in task 3.

Task 3: Check the status of the export
Copy link

Once you have run the initial request in task 2, you will need to create an additional request to check the status of the export. This allows you to verify that the initial request ran successfully and to access the URLs you need to download to export the data.

To check the export status:

  1. In Postman, click the three dots beside the relevant Collection and select Add Request.
  2. Change the query to GET using the dropdown in the query bar.
  3. Paste the region URI from task 1.
  4. Go to the Headers tab.
    1. Paste X-Api-Key into the Key column.
    2. Paste the API key from task 1 into the Value column.
  5. Go to the Body tab.
    1. Select GraphQL from the options at the top of the tab.
    2. In the Query section, paste this query, replacing EXAMPLEID with the unique string you copied in task 2.
query GetExport { export(id: "EXAMPLEID"){ id status dataset timestamp result { prefix urls } } }
  1. Click Send in the query bar. This will begin to run the request.
  2. Under Body you will see a response which will outline the status of the initial request from task 2.

Task 4: Download the Parquet files
Copy link

Once the status of the request from task 3 becomes SUCCEEDED, you will see mutliple URLs listed, each with a prefix value.

Each prefix will outline what data is included in that URL, for example the URL tied to "prefix": "asset" will be an export of asset data.

You may have more than one URL relating to one prefix. This is dependant on the size of your environment and the amount of information contained in the export.

  • Each time download URLs are generated, they remain valid for 15 minutes. Within this window, files can be downloaded as many times as needed.
  • These URLs can be regenerated at any time within 30 days of the initial request.
  • Exported files are retained for 30 days. After that, attempts to access the files will result in an error.

Parquet files
Copy link

These schemas provide an overview of the fields returned in the files at the URLs provided:

Agent-based policy export
Copy link

asset

FieldTypeDefinitionExample
orgIdStringOrganization IDa08de390-bb6a-4297-b1df-9ee58c7beb7a
assetIdStringAsset ID2b2b6a57-9136-4874-8af1-3f9f0a6de60a-default-asset-1
agentIdStringAgent ID586d68c92af55c27b7bfecf7f6df0cb4
awsInstanceIdStringThe Amazon Web Services instance ID of the asset, if applicablei-0e1cc483957bc29d8
azureResourceIdStringThe Azure resource identifier of the asset, if applicable
gcpObjectIdStringThe Google Cloud Platform identifier of the asset, if applicable
macStringThe primary MAC address of the asset0050568A103C
ipStringThe primary IP address of the asset0.0.0.0
hostNameStringThe primary hostname of the assettesthost.us
osArchitectureStringArchitecture of the OS on the assetx86_64
osFamilyStringFamily of the OS on the assetWindows
osProductStringProduct of the OS on the assetWindows Server 2016 Standard Edition
osVendorStringVendor of the OS on the assetMicrosoft
osVersionStringThe OS version on the asset1607
osTypeStringType of OS on the assetServer
osDescriptionStringThe description for the operating systemMicrosoft Windows Server 2016 Standard Edition 1607
riskScoreDoubleThe asset risk score10000.0
sitesListArray of sites the asset belongs to[site1, site2]
assetGroupsListThe groups the asset is part of[group1, group2]
tagsListThe tags present on the asset[{name: tag1, tagType: Owner}, {name: tag2, tagType: Location}]

asset_policy

FieldTypeDefinitionExample
orgIdStringOrganization IDa08de390-bb6a-4297-b1df-9ee58c7beb7a
assetIdStringAsset ID2b2b6a57-9136-4874-8af1-3f9f0a6de60a-default-asset-1
benchmarkNaturalIdStringThe natural ID of the XCCDF benchmarkxccdf_org.cisecurity.benchmarks_benchmark_2.0.0_CIS_Google_Chrome_Benchmark
profileNaturalIdStringThe natural profile of the XCCDF benchmarkxccdf_org.cisecurity.benchmarks_profile_Level_1_L1_-_CorporateEnterprise_Environment_general_use
benchmarkVersionStringThe version of the XCCDF benchmark2.0.0
ruleNaturalIdStringThe natural ID of the XCCDF rulexccdf_org.cisecurity.benchmarks_rule_3.6_L1_Ensure_Control_how_Chrome_Cleanup_reports_data_to_Google_is_set_to_Disabled
ruleTitleStringThe title of the XCCDF rule3.6. (L1) Ensure 'Control how Chrome Cleanup reports data to Google' is set to 'Disabled'
finalStatusStringThe final status of the rule finding, after applying overridesFAIL
proofStringText describing how the status was determined<p><p>Based on the following 1 results:<ol><li><p><ol><li><p>At least one specified Windows registry information entry must match the given criteria. At least one evaluation must pass.<Table TableTitle=""><Table.Tr RowTitle=""><Table.Td>The specified Windows registry information entry was not found based on the given criteria:</Table.Td></Table.Tr><Table.Tr RowTitle=""><Table.Td>hive: HKEY_LOCAL_MACHINE</Table.Td></Table.Tr><Table.Tr RowTitle=""><Table.Td>key: SOFTWARE\Policies\Google\Chrome</Table.Td></Table.Tr><Table.Tr RowTitle=""><Table.Td>name: ChromeCleanupReportingEnabled</Table.Td></Table.Tr></Table></p></li></ol></p></li></ol></p></p>
lastAssessmentTimestampTimestampThe last time the policy was assessed2022-12-06T04:07:44.471Z
benchmarkTitleStringThe title of the XCCDF benchmarkCIS Google Chrome Benchmark
profileTitleStringThe title of the XCCDF profileLevel 1 (L1) - Corporate/Enterprise Environment (general use)
publisherStringThe publisher of the policyCIS
fixTextsListData describing how to bring a target system into compliance with the rulefixTexts=[ &lt;xhtml:div xmlns="http://checklists.nist.gov/xccdf/1.2" xmlns:cc6="http://cisecurity.org/20-cc/v6.1" xmlns:cc7="http://cisecurity.org/20-cc/v7.0" xmlns:notes="http://benchmarks.cisecurity.org/notes" xmlns:xccdf="http://checklists.nist.gov/xccdf/1.2" xmlns:xhtml="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"&gt;&lt;xhtml:p&gt;&lt;xhtml:p&gt;To establish the recommended configuration via Group Policy, set the following UI path to &lt;xhtml:span class="inline_block"&gt;Disabled&lt;/xhtml:span&gt; : &lt;/xhtml:p&gt; &lt;xhtml:code class="code_block"&gt;Computer Configuration\Administrative Templates\Google\Google Chrome\Control how Chrome Cleanup reports data to Google &lt;/xhtml:code&gt; &lt;xhtml:p class="bold"&gt;Impact:&lt;/xhtml:p&gt; &lt;xhtml:p&gt; &lt; xhtml:p&gt; Chrome Cleanup detected unwanted software, will no longer report metadata about the scan to Google.&lt;/xhtml:p&gt; &lt;/xhtml:div&gt; ]
rationalesListDescriptive text giving rationale or motivations for abiding by the rule[<xhtml:p xmlns="http://checklists.nist.gov/xccdf/1.2" xmlns:cc6="http://cisecurity.org/20-cc/v6.1" xmlns:cc7="http://cisecurity.org/20-cc/v7.0" xmlns:notes="http://benchmarks.cisecurity.org/notes" xmlns:xccdf="http://checklists.nist.gov/xccdf/1.2" xmlns:xhtml="http://www.w3.org/1999/xhtml" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">Anonymous crash/usage data can be used to identify people, companies and information, which can be considered data ex-filtration from company systems.</xhtml:p>]

Vulnerability export
Copy link

asset

FieldTypeDefinitionExample
orgIdStringOrganization IDa08de390-bb6a-4297-b1df-9ee58c7beb7a
assetIdStringAsset ID2b2b6a57-9136-4874-8af1-3f9f0a6de60a-default-asset-1
agentIdStringAgent ID586d68c92af55c27b7bfecf7f6df0cb4
awsInstanceIdStringThe Amazon Web Services instance ID of the asset, if applicablei-0e1cc483957bc29d8
azureResourceIdStringThe Azure resource identifier of the asset, if applicable
gcpObjectIdStringThe Google Cloud Platform identifier of the asset, if applicable
macStringThe primary MAC address of the asset0050568A103C
ipStringThe primary IP address of the asset0.0.0.0
hostNameStringThe primary hostname of the assettesthost.us
osArchitectureStringArchitecture of the OS on the assetx86_64
osFamilyStringFamily of the OS on the assetWindows
osProductStringProduct of the OS on the assetWindows Server 2016 Standard Edition
osVendorStringVendor of the OS on the assetMicrosoft
osVersionStringThe OS version on the asset1607
osTypeStringType of OS on the assetServer
osDescriptionStringThe description for the operating systemMicrosoft Windows Server 2016 Standard Edition 1607
riskScoreDoubleThe asset risk score10000.0
sitesListArray of sites the asset belongs to[site1, site2]
assetGroupsListThe groups the asset is part of[group1, group2]
tagsListThe tags present on the asset[{name: tag1, tagType: Owner}, {name: tag2, tagType: Location}]

asset_vulnerability

FieldTypeDefinitionExample
orgIdStringOrganization IDa08de390-bb6a-4297-b1df-9ee58c7beb7a
assetIdStringAsset ID2b2b6a57-9136-4874-8af1-3f9f0a6de60a-default-asset-1
vulnIdStringVulnerability IDmsft-cve-2023-29372
portIntegerThe scanned port the vulnerability is present on, if applicable22
protocolStringThe scanned protocol the vulnerability is present on, if applicableTCP
nicStringThe scanned network interface, if applicable
proofStringProof describing how the asset is vulnerable to the vulnerability<p><p>Vulnerable OS: Microsoft Windows Server 2012 R2 Standard Edition<p></p></p><p>Based on the following 3 results:<ol><li><p>Microsoft patch KB5027282 is not installed.</p></li><li><p>Microsoft patch KB5027271 is not installed.</p></li><li><p><ul><li>HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion<ul><li>UBR - contains unexpected value 20337</li></ul></li></ul></p></li></ol></p></p>
firstFoundTimestampTimestampTimestamp of when the vulnerability was found on the asset2023-11-06T11:40:37.000Z
titleStringThe title of the vulnerabilityMicrosoft CVE-2023-29372: Microsoft WDAC OLE DB provider for SQL Server Remote Code Execution Vulnerability
descriptionStringThe description of the vulnerability, containing a mix of HTML/XML contentMicrosoft CVE-2023-29372: Microsoft WDAC OLE DB provider for SQL Server Remote Code Execution Vulnerability
cvssAccessComplexityStringThe CVSS V2 access complexity of the vulnerabilityM
cvssAccessVectorStringThe CVSS V2 access vector of the vulnerabilityN
cvssAuthenticationStringThe CVSS V2 authentication of the vulnerabilityN
cvssAvailabilityImpactStringThe CVSS V2 availability impact of the vulnerabilityC
cvssConfidentialityImpactStringThe CVSS V2 confidentiality impact of the vulnerabilityC
cvssIntegrityImpactStringThe CVSS V2 integrity impact of the vulnerabilityC
cvssScoreDoubleThe CVSS V2 score of the vulnerability8.8
cvssV3AttackVectorStringThe CVSS V3 attack vector (AV) of the vulnerabilityNetwork
cvssV3AttackComplexityStringThe CVSS V3 attack complexity (AC) of the vulnerabilityLow
cvssV3PrivilegesRequiredStringThe CVSS V3 privileges required (PR) of the vulnerabilityNone
cvssV3UserInteractionStringThe CVSS V3 user interaction (UI) of the vulnerabilityRequired
cvssV3ScopeStringThe CVSS V3 scope (S) of the vulnerabilityUnchanged
cvssV3ConfidentialityStringThe CVSS V3 confidentiality (C) of the vulnerabilityHigh
cvssV3IntegrityStringThe CVSS V3 integrity (I) of the vulnerabilityHigh
cvssV3AvailabilityStringThe CVSS V3 availability (A) of the vulnerabilityHigh
cvssV3ScoreDoubleThe CVSS V3 score of the vulnerability8.8
cvssV3SeverityStringThe CVSS V3 severity of the vulnerabilityHigh
cvssV3SeverityRankIntegerThe CVSS V3 severity rank of the vulnerability4
skillLevelStringThe skill level of the vulnerabilityunknown
skillLevelRankIntegerThe skill level rank of the vulnerability4
severityStringThe severity of the vulnerabilityCritical
severityRankIntegerThe severity rank of the vulnerability3
severityScoreIntegerThe severity score of the vulnerability9
hasExploitsBooleanWhether there are exploits associated with the vulnerabilityfalse
threatFeedExistsBooleanWhether a threat feed exists for the vulnerabilityfalse
pciCompliantBooleanWhether the vulnerability is PCI compliantfalse
pciSeverityIntegerThe PCI severity of the vulnerability5
riskScoreDoubleThe real risk score of the vulnerability. Used only when riskScoreV2_0 is not present348.70102
riskScoreV2_0IntegerThe active risk score of the vulnerability589
cvesListAn array of CVE IDs applicable to the vulnerability[CVE-2023-29372]
dateAddedTimestampTimestamp of when the vulnerability was added2023-06-13T00:00:00.000Z
dateModifiedTimestampTimestamp of when the vulnerability was modified2023-06-15T00:00:00.000Z
datePublishedTimestampTimestamp of when the vulnerability was published2023-06-13T00:00:00.000Z
tagsListThe tags associated with the vulnerability[Apple, Apple Mac OS X]
checkIdStringUnique identifier associated with the checkWINDOWS-HOTFIX-MS13-098-x64
reintroducedTimestampTimestampTimestamp of when the vulnerability reappeared on the asset after previously being marked as remediated2023-06-15T00:00:00.000Z
epssscoreDoubleExploit Prediction Scoring System (EPSS) score is a data-driven probability score from 0 to 1 (or 0% to 100%) that a specific software vulnerability will be exploited in the wild within the next 30 days0.043800000
epsspercentileDoubleThe percentage of all CVEs that have an Exploit Prediction Scoring System (EPSS) score equal to or lower than this one.0.88546000

Vulnerability remediations export
Copy link

vulnerability_remediation

FieldTypeDefinitionExample
orgIdStringOrganization IDa08de390-bb6a-4297-b1df-9ee58c7beb7a
assetIdStringAsset ID2b2b6a57-9136-4874-8af1-3f9f0a6de60a-default-asset-1
cveIdStringCVE IDCVE-YYYY-NNNNN
vulnIdStringVulnerability IDmsft-cve-2023-29372
proofStringProof describing how the asset is vulnerable to the vulnerability<p><p>Vulnerable OS: Microsoft Windows Server 2012 R2 Standard Edition<p></p></p><p>Based on the following 3 results:<ol><li><p>Microsoft patch KB5027282 is not installed.</p></li><li><p>Microsoft patch KB5027271 is not installed.</p></li><li><p><ul><li>HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion<ul><li>UBR - contains unexpected value 20337</li></ul></li></ul></p></li></ol></p></p>
firstFoundTimestampTimestampTimestamp of when the vulnerability was found on the asset2023-11-06T11:40:37.000Z
reintroducedTimestampTimestampTimestamp of when the vulnerability was reintroduced on the asset2023-11-06T11:40:37.000Z
lastDetectedTimestampTimestamp of vulnerability remediation, determined by the last detection of the vulnerability on the asset.2023-11-06T11:40:37.000Z
lastRemovedTimestampTimestamp of when the vulnerability was last removed from the asset2023-11-06T11:40:37.000Z
titleStringThe title of the vulnerabilityMicrosoft CVE-2023-29372: Microsoft WDAC OLE DB provider for SQL Server Remote Code Execution Vulnerability
descriptionStringThe description of the vulnerability, containing a mix of HTML/XML contentMicrosoft CVE-2023-29372: Microsoft WDAC OLE DB provider for SQL Server Remote Code Execution Vulnerability
cvssV2ScoreDoubleThe CVSS V2 score of the vulnerability8.8
cvssV3ScoreDoubleThe CVSS V3 score of the vulnerability8.8
cvssV2SeverityStringThe CVSS V2 severity of the vulnerabilityHigh
cvssV3SeverityStringThe CVSS V3 severity of the vulnerabilityHigh
cvssV2AttackVectorStringThe CVSS V2 attack vector (AV) of the vulnerabilityNetwork
cvssV3AttackVectorStringThe CVSS V3 attack vector (AV) of the vulnerabilityNetwork
riskScoreV2_0IntegerThe active risk score of the vulnerability589
datePublishedTimestampTimestamp of when the vulnerability was published2023-06-13T00:00:00.000Z
dateAddedTimestampTimestamp of when the vulnerability was added2023-06-13T00:00:00.000Z
dateModifiedTimestampTimestamp of when the vulnerability was modified2023-06-15T00:00:00.000Z
epssscoreDoubleExploit Prediction Scoring System (EPSS) score is a data-driven probability score from 0 to 1 (or 0% to 100%) that a specific software vulnerability will be exploited in the wild within the next 30 days0.043800000
epsspercentileDoubleThe percentage of all CVEs that have an Exploit Prediction Scoring System (EPSS) score equal to or lower than this one.0.88546000