How to build data export products using MongoDB Atlas
In recent years, leading software companies such as Stripe, Segment, LogRocket, and Modern Treasury have all launched data export products. These products go by a range of names, including Data Pipelines, Push to Data Warehouse, and Streaming Exports. While the packaging is different, their core function is the same: Giving customers direct access to the data that software companies have collected and saved on their behalf.
Now, software companies that run on MongoDB Atlas, the popular multi-cloud developer data platform, can build data export products using Prequel’s Data Export Platform and safely share data with customers on 20+ data platforms, including Snowflake, BigQuery, Databricks, and MongoDB.
How Prequel’s Data Export Platform Works
Companies decide which tables they are open to sharing, and customers choose which tables they want access to. For example, a payment processing platform may share tables related to invoices, transactions, and success codes with their customers. Customers can then choose the tables they want to receive and how often they want them updated.
Data is replicated using an ephemeral server, which reads data from the source and then upserts that data into the destination. Data is reformatted in flight so that it’s compatible with the destination. No data remains on Prequel’s servers once the data is transferred.
Prequel’s Data Export Platform can replicate up to 100 million rows of data per destination in just 15 minutes. It supports multi-tenancy, eventual consistency, and more.
Why won’t an API work?
APIs are a great way to pass event-based data between two systems, but both sides need to do a lot of work to set them up, changes to data structures are complicated, and they aren’t built for frequent, high-volume transfers.
Data export, by contrast, is a great fit when:
- Your company doesn’t have time to build an API,
- Your customers don’t have time to build an ingest pipeline,
- Your customers want access to a large quantity of information that gets updated frequently, or
- The data model may change, and supporting those changes might not be a priority.
With Prequel’s Data Export Platform, customers can easily access all the data they need, with far less work for everyone at every point in the product lifecycle.
A Thoughtful Customer Experience
Prequel puts up-to-date, analysis-ready data right where enterprise customers need it — directly into their existing database, data warehouse, or object storage.
The entire customer experience is white-labeled from start to finish.
Customers can sign up in a couple of clicks. They select the data platform they use from a drop-down menu, choose the tables they want to receive, and how often they want the data updated, from every 15 minutes to once daily.
Launch Data Export in One Day
Prequel is engineered to make deployment easy. After becoming a Prequel customer, all teams need to do is:
- Connect MongoDB Atlas to Prequel
Follow the 4-step directions here. - Outline the data to be shared
Use version-controlled schemas to outline the data. - Connect Prequel
Confirm the connection with test data.
Once a connection has been made, companies can begin sharing data with customers on 20+ platforms.
Onboarding customers is simple. Companies can send magic links to customers, allowing them to set up their destinations online. Companies can also choose to embed a sign up form in a website or set up destinations manually.
Prequel also automatically generates a data type map that outlines how data types change across data stores, simplifying the documentation process for companies.
Security and Deployment Options
Companies can use Prequel’s cloud-based service or deploy Prequel privately, depending on the company’s needs. When Prequel is deployed privately, no customer data passes through Prequel’s servers.
Prequel also supports a wide range of connection modalities, including SSH tunneling, SSO, and role-based authentication.
Further information
For more information on Prequel for MongoDB, please set up a time to talk to one of our engineers or visit prequel.co.
