🚀 Product Updates

🔨 Connector Builder

We are excited to release our new connector builder for taps! Using the connector builder, you can create taps on hotglue without writing any code at all. Check out the demo below:

Read the docs here: https://docs.hotglue.com/custom-connectors/connector-builder

If you have questions on using the connector builder, contact us!

⚡ Real-time write

When writing data to a connector – for example, creating a Contact in Salesforce or an Order in Shopify – seeing that data go through immediately and giving the user instant feedback can be a game changer.

Instead of kicking off an asynchronous hotglue job to write data, you can now use our API to send data to connectors instantly. Check out the demo below:

This feature is in beta and we are expanding which connectors are supported (at the time of writing, Salesforce and Shopify are live). If you’re interested in trying this feature out, let us know! More info on the docs: https://docs.hotglue.com/api-reference/real-time/write

⛓️ Streaming Read Jobs

In cases where the Python transformation layer is not needed, you can now stream data directly from a connector to a target.

What does that mean?

Traditionally hotglue jobs go through each step of the ETL pipeline:

• extract (read raw data from a connector like HubSpot),
• transform (use our Python layer to process the data), and finally
• load (write the final data to a target like your API or a database).

Instead of following that lifecycle, streaming jobs do both the extract and load steps concurrently, which means we send data to your target as we are pulling it from the source system.

This can be super useful for scenarios where you’re importing lots of historical data, and want your customers to see that data being populated while the import is in progress.

Check out the demo here:

This feature is in beta currently, and we plan to expand support to database targets such as Postgres, BigQuery, and more. If you’re interested in trying it out, let us know!

🔌 Connector Updates

🧾 Accounting unified schema v2 for NetSuite (now in beta!)

Our engineering team has been hard at work on creating v2 of our accounting unified schema! We are launching beta access to the new version with NetSuite, and we plan to release support for Microsoft Dynamics Business Central and Sage Intacct next.

The new version features major improvements including:

• better performance across read and write jobs
• improved error messages and validation for writing data
• clear documentation of supported objects and how they map to each connector
• schema and type enforcement across connectors for both read and write jobs to ensure high data quality
• target state for write jobs with summaries of posted records and detailed validation errors

Check out the docs here: https://hotglue.com/docs/unified/accounting

That’s all for this month! Thanks for reading :)

Want to chat with our team? Book a demo.

🚀 Product Updates

⚡10x faster discovers for CRM connectors

We have shipped major performance improvements on our core CRM connectors: Salesforce and HubSpot. Previously, refreshing a field map would take 2 minutes on average – with this update it’s down to 10 seconds!

Note that the time will vary based on how many objects exist within the CRM instance, and this update is not live if you're using a forked version of a connector.

These improvements will be rolled out to more connectors in March. Let us know if there are specific connectors you want to see with this improvement.

🌓 Dark Mode

You asked and we listened! We have introduced a dark mode option in the hotglue admin dashboard – simply use the dark mode toggle in the navbar to switch. Here’s a quick preview:

⚙️ React 19+ support for the hotglue widget

We have introduced a new major release (1.5.x) of the @hotglue/widget package which introduces support for React 19+ and newer NextJS versions. This version is still in beta but is already available on npm.

Note that 1.5.x is not yet backwards compatible with React 18 or lower, and we will continue support for React 18 with updates on 1.4.x. If you run into any issues, don’t hesitate to reach out!

🔧 Automatic handling of stuck jobs

We have introduced improved automatic handling and detection of stuck jobs using a heartbeat.

With this release, hotglue automatically detects jobs that are hung and retriggers them. This typically comes up when jobs run out of memory or hit unexpected connector errors.

We expect this release will improve stability and result in fewer unexpectedly failed jobs. If you have any questions, let us know!

🔌 Connector Updates

⚠️ Shopify is migrating to GraphQL and deprecating REST

Shopify is in the process of deprecating their REST APIs in favor of their newer GraphQL API. As of February 1st they require all Shopify apps to use their GraphQL endpoints for products, or they will be delisted. No action is required on your side – we added a “compatibility” layer in our _tap-shopify_which replaces our REST API calls for products with GraphQL queries and maps the data to the original REST schema. You can review the changes on our GitHub repository.

Shopify will be continuing to deprecate resources in REST and is encouraging all users to migrate to GraphQL. Additionally, any new fields/objects will only be made available in GraphQL. To help with this transition, we have developed a tap-shopify-v2 which leverages the GraphQL API instead (see GitHub). If you’re interested in learning more about migrating to the new connector, reach out to us.

🏎️ Microsoft SQL target is faster + more stable

We have done a significant rework of our target for Microsoft SQL Server, which has led to significantly better performance and throughput as well as improved stability.

Under the hood we are leveraging bcp which is SQL Server’s bulk copy utility instead of sending records via SQL. If curious, you can see the changes in GitHub.

That’s all for this month! Thanks for reading :)

Want to chat with our team? Book a demo.

Welcome to our April Melt! Here’s what you may have missed from the past month.

New Connectors ⛓️

We added 5 new integrations to our library and the open-source Singer community in April.

Logic4

Keyna from our integrations team built a tap and target for Logic4 (logic4.nl), an e-commerce and ERP platform based in the Netherlands. You can use the connectors to fetch inventory, purchase, and sales information, and write back transactions like purchase orders.

Bird (formerly MessageBird)

Keyna built a target for Bird (bird.com), an omnichannel communications platform and CRM. Built on Hotglue’s target SDK, the target lets you push any data, like new contacts, to your customers’ Bird CRM accounts.

Appsflyer

Adil from our integrations team built a target for Appsflyer (appsflyer.com), a mobile marketing analytics tool. Combined with our existing Appsflyer tap, the new target allows you to offer bi-directional connectivity with your customers’ Appsflyer apps.

Connectwise

Our partner, Plentive, built a connector to read data from Connectwise (connectwise.com), an MSP management solution. The tap fetches data such as projects, activities, and time entries.

ClientTether

Chauncy from Plentive also built a connector for ClientTether (clienttether.com), a CRM for franchises. The connector fetches general CRM data from your customers’ ClientTether accounts.

We also released a Confluence connector out of beta, thanks to a fork of Edgar Ramírez Mondragón’s Singer tap.

New API endpoints 🚥

We released two new API endpoints last month.

catalog/search

Run fast, granular searches across catalogs to search for streams, fetch types, and more. This is particularly useful for large catalogs that are too big to be served in a single linkedSource fetch.

discover/kill

Just like the Kill Jobs endpoint, you can use this to end any running discovers for a linked connection.

Job log quality of life updates 🔁

You may also notice some minor QoL updates to your log viewing experience:

• Logs now open with the erroring section loaded, rather than the first line of the log
• We added new navigation pills to quickly skip between the sync, ETL, and export sections
• Logs are now clickable as soon as jobs kick off

Job-level environment variable control ✅

You have more control than ever over the behavior that your jobs run with.

POST /jobs

When making a POST to `/jobs`, you can define override environment variables. This could be an existing reserved variable (max_record_count, default_export_format) or a custom environment variable used in your ETL.

Schedules

When setting schedules, you can now configure schedules to run with specific environment variables and job settings, just like manual job runs. Supported params in schedules now include:

• override_start_date
• override_selected_tables
• override_field_map
• environment_variables

Got questions, or have requests you’d like to see us build? Reach out to us in Slack or at hello@hotglue.xyz.

See you next month 🙂

- Brendan

Hey hotgluers,

Welcome to the hotglue melt.

Before we jump into what’s new in hotglue, we have a few major updates that we are slowly rolling out in a limited beta.

Real-time writes remove the need for a job process to POST data using our unified API. If you use our API to write data (not a reverse ETL from a Database or filestore), this lets you see the validations or success responses right when you POST. The limited beta is for Quickbooks and Shopify, with more to come with the general release.

Thereal-time webhook handler runs high-throughput trigger-based workflows without the need for full job processes. This is built on top of our real-time triggers–now they are just much faster, smaller, and more flexible.

If these are relevant to you, and you want to try them out before general release, let us know!

Reach out to us at hello@hotglue.xyz

Now, for what’s new:

Connector-level schedules 🗓️

With connector-level schedules, you can maintain individual schedules for each connector - either as an alternative or an addition to existing flow-level schedules. This enables use cases like:

• Running multiple schedules for the same connection, like an hourly sync and a weekly catch-all.
• Building automations to pause and re-enable certain integrations.

Updated email notification system 📢

If you use emails to track job failures, you may have noticed some changes to the emails you get:

• You can now configure email notifications on an environment-level, rather than across all environments. Environment-level emails can be configured in Settings > Notifications, while Organization-level emails remain in your account settings.
• Daily report emails now display the error messages and their associated tenants, rather than a list of failing tenants. This should make it easier to track error patterns without needing to navigate your hotglue admin panel.

Other features 🚀

• **Restrict upload file types in the widget.
  **In Settings > Widget, you can now configure a list of supported file types for file uploads. Use this to only allow discoverable files (csv and excel), or otherwise limit uploads to files that your ETL is prepared to handle.

• **Jupyter speed boost
  **Your environment and script-level dependencies are now downloaded and cached the first time you run Jupyter. That means that subsequent Jupyter startup times are significantly faster now.

• **Memory failure auto-retriggers
  **Large jobs occasionally need more memory and storage than is provisioned by default. In Settings > Jobs > Error management, you can now configure jobs to automatically retrigger with increased memory on OOM failures.

—

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hey everyone! Welcome to our monthly hotglue melt. Here’s a rundown of the hotglue features you may have missed.

Faster jobs ⏩

Over the past few weeks, our backend team has pushed some big changes to help make jobs faster. We’ve seen job time savings of anywhere from 40 seconds to over 3 minutes, and there’s more to come. The improvements to date include:

• ETL Dependency Caching: Jobs now only update and install ETL dependencies when necessary.
• Asynchronous Job Status Webhooks: Jobs no longer wait for webhook responses. If your webhook endpoint takes a while to respond, you’ll notice big gains here.
• Dynamic Installation of Database Drivers: hotglue now intelligently installs database drivers, only when required.
• Refined Python Venv Inits: We’ve refactored how we initialize virtual environments, to remove unnecessary overhead from the runtime.

Next steps: We’re working through individual connectors to add more concurrency, and adding some additional optimizations to the job executor.

Redesigned on-premise connectors (Sage 50 UK and Quickbooks Desktop)

Sage 50 UK and Quickbooks Desktop are installed executables available on our Basic Plan and above. They can now be linked in under a minute and managed remotely, with:

• JWT-secured password authentication
• Remote logging
• Auto-updates with the hotglue launcher
• Remote config and state management

Here’s a demo of how this works for QBD.

New Integrations 🔁

Over the past few weeks, our integrations team contributed three new connectors to hotglue’s library and the Singer community:

• Linnworks (tap), built by Vinnie
• Precoro (target), built by Keyna
• Sellercloud (tap), built by Adil

Our customer Plentive also contributed four new Singer connectors, which are all available to use in any hotglue environment:

• BQE
• VantagePoint
• Quickbooks Time
• Crelate

Lastly, we improved some existing open-source connectors and added them to the hotglue library:

• Redshift (tap), originally built by Monad
• LinkedIn Ads (tap), originally built by Singer.io
• Clickhouse (target), originally built by Shaped.ai

Fixes and improvements 🛠️

Frontend:

• The billing page now shows your invoices for download, and you can assign billing page access to multiple user accounts
• The job download process runs faster now, and no longer requires pop-ups to be enabled.
• You can now “clone” connectors across the same environment
• Jupyter notebooks run on Python 3.10 if you use our V3 job executor.
• The widget custom mapping tab text can now be customized

Jobs and stability:

• A new environment setting to retrigger jobs automatically when they hit memory limits

• When a catalog’s size surpasses AWS API Gateway’s max limits, it is now trimmed to a “lite” version in API responses. The full catalog is still used by syncs and ETL scripts.

• Added code coverage and mock classes for Salesforce Apex triggers and classes

• Google sheets discovery is now up to 12x faster in the widget.

• We added new CLI functions and API endpoints, including:

  • CLI: `hotglue tenants custom-etl` to find tenants with forked ETLs
  • API: `PATCH /linkedConnectors` for updating v2 flow configs

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Welcome to our year-in-review 2023 hotglue melt!

To those who’ve been around for a while, thank you for building your integrations on hotglue.

You make hotglue a better product with your feedback, and we’re always excited to see the creative ways you put hotglue to use.

As we begin the new year, we wanted to take a brief moment to look at how hotglue has changed over the last year. As always, feel free to reach out in Slack with your questions and suggestions for 2024!

2023 hotglue in summary 📋

Our integrations team built 83 open-source connectors. That included support for 61 net new SaaS and on-premise applications.

hotglue jobs are now much faster, thanks to a rebuilt runtime and deployment pipeline.

We added new modules across the admin panel, including the Jobs, Errors, White-Label, Connector Settings, and Environment Variables features.

Our new bi-directional flows make reading and writing data with your customers’ integrations dead-simple.

The hotglue team built a new Singer target SDK, making for simple, transparent exports to our most popular SaaS connectors.

Bi-directional flows↔️

Before 2023, hotglue flows always consisted of a linked source and a linked target. This made for dead-simple setups when you only needed to move data in one direction.

However, bi-directional integrations where you need to consistently read and write data were not simple to set up in hotglue: you needed two separate flows with symlinked credentials.

Now, with hotglue bi-directional “V2” flows, this is supported out of the box. Rather than thinking about target flows, `linkedSources`, and `linkedTargets`, every integration that a customer links in a V2 flow is simply a connector.

Bi-directional flows come with a new set of “V2” endpoints. If you’re not already using V2 flows, you can try them out by creating a new flow, and leaving the “bi-directional” toggle turned on. Let us know if you want to discuss migrating your existing flows over!

New tools in your dashboard🖥️

In 2023, we pushed some major updates to how you use the hotglue admin panel. You may have noticed the new jobs and errors panels, but there are other features spread through your dashboard that you may find useful:

• Connector Settingsallows you to define granular settings for your connectors, like the fields exposed in the widget, default config values, and the `install_uri` for custom git branches.
• Environment variables allow you to add additional variables for you to use in your ETL scripts on the fly, such as API URLs, flags, and keys.
• The Jobs panel lets you run fine-grained searches for jobs.
• The Errors panel gives you an overview of the most common errors affecting your tenants.
• The Tenant Drawer allows you to view and edit settings for your tenant, including the `tenant-config`, tenant metadata like org names, job schedules, and job history.
• White-label settings lets you customize the OAuth page, including your callback URI, logos, background colors, and loading text.
• We also added a host of environment settings, including more options for job failure recovery and Slack and Heap job monitoring.

Faster jobs: a new job executor and connector deployment pipeline🕐

Last year, we frequently heard that you wanted jobs to kick off and run faster. We rebuilt our job runtime from the ground up with that in mind. The new version of the executor has two main benefits:

1. Faster builds for discovers and jobs - Jobs and discovers spend 60% less time queuing up, which means less time stuck in JOB_STARTED.
2. More flexibility with python versions - Our V3 executor defaults to Python 3.10. This is now much more customizable if you have specific version requirements.

We also re-designed our connector deployments using Jenkins, which removes dependency installation from the job runtime.

You can check which executor your jobs use by parsing your job status webhooks. If the `task_definition.id` shows `hotglue-executor-v3`, you’re using our modernized architecture!

Hotglue’s new SDK for writing Singer targets🎯

The main challenge with using Singer targets has historically been understanding which records were created, and where validations happened. Traditional Singer targets either succeed (data probably loaded in) or fail (some data may have been loaded in, but not all of it). Hotglue’s new target SDK is designed to fix this.

The root concept in Hotglue’s target SDK is the `target_state`. The target state contains important data about what the target did, including:

• How many records were created, updated, or failed to load
• The success or failure codes for each record, and the new `id` from the target system, if returned.
• Failure messages for records that didn’t go through

In 2023, we built or upgraded 32 targets using hotglue’s target SDK. If you’re using a target that isn’t on this list yet, let us know! It may already be in our pipeline:

• Quickbooks
• Freshbooks
• Salesforce
• API
• Zoho Inventory
• Sendgrid
• Jira
• Salesforce Commerce
• Lob
• Montapacking v2
• Exact
• Picqer
• Xero v3
• Etsy
• Squarespace
• Constantcontact
• Aturian
• Odoo v3
• Sage300
• Dynamics Onprem
• Brevo
• Magento v2
• Keap
• Shipbob
• Dynamics BC Onprem
• Brikl
• BigCommerce
• Restaurant365
• Zendesk
• Zohobooks v2
• Precoro

Widget improvements🔧

If you’re not using the widget or not using many widget features, you may have missed the updates we’ve been shipping all year: https://www.npmjs.com/package/@hotglue/widget?activeTab=versions

Note for React users: At the time of writing, the current version of @hotglue/widget is v1.4.46. You may need to update your widget version to access some of these features.

• Subtenants are now native to the widget, which you can enable in your widget settings. When turned on, your users can link multiple instances of the same integration.
• Your custom field mappingpage has a host of new features, including required tables and fields, multiple mappings per table, and localization.
• For those looking for a more custom workflow in the widget, we’ve added many new listeners, filters, and nextStep workflow actions across the widget.
• You can also now define more widget and connection behavior by passing values directly in your frontend code, including tenant metadata, dynamic OAuth parameters, and localization text.

New connectors🔁

We added 61 new integrations in 2023, including 11 brand new bi-directional integrations, 29 new taps, and 21 new targets. We also rebuilt many of our most well-used connectors, which are not listed below.

Accounting and Inventory:

• Abra (tap)
• Dynamics NAV on-premise (Bi-directional)
• Dynamics BC on-premise (Bi-directional)
• Exact (target)
• Invoiced (tap)
• Katana (tap)
• Microsoft Dynamics BC (target)
• Nexar (tap)
• Precoro (Bi-directional)
• PropX (tap)
• Quickbooks Desktop (target)
• Restaurant 365 (Bi-directional)
• Sage 300 (Bi-directional)
• Sage 50 UK (target)
• Zoho Inventory (Bi-directional)

E-commerce and Order Management:

• Amazon Vendor Central (tap)
• BigCommerce (target)
• Bol (tap)
• Brikl (Bi-directional)
• Etsy (Bi-directional)
• Marketplacer (Bi-directional)
• Picqer (Bi-directional)
• QLS (Bi-directional)
• Salesforce Commerce Cloud (Bi-directional)
• Shiphero (tap)
• Shipbob (target)
• Squarespace (Bi-directional)
• Square (target)
• Storyous (tap)
• Toast (tap)
• Wix (target)

CRM and Email:

• Affinity (tap)
• Blackbaud (target)
• Brevo (target)
• Campaign Monitor (target)
• Constant Contact (target)
• GoHighLevel (tap)
• Keap (target)
• Klaviyo (target)
• Pipedrive (target)
• Salesforce Marketing Cloud (tap)
• Salesloft (tap)
• Sendgrid (target)

Database and Data Storage:

• Databox (target)
• Google Cloud SQL (Postgres) (Bi-directional)
• Microsoft Excel (tap)
• Microsoft SQL (tap)
• PowerBI (target)
• Redshift (target)

Support and Project Management:

• Clickup (target)
• Gladly (tap)
• Gong (target)
• Jira (target)
• Livechat (tap)
• Monday.com (tap)
• Stella Connect (tap)
• Zendesk (target)
• Zendesk Chat (tap)

Other Integrations:

• Apple App Store (tap)
• Azure Active Directory (tap)
• Chargify (tap)
• Jotform (tap)
• Trustpilot (tap)

Next up 📈

Thanks so much for reading! These are some things we have coming up:

• Real-time data posting that enables instant data syncing
• A brand new ETL experience in the admin panel
• Faster performance across the product
• Big updates to hotglue's on-premise connectors

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

New integrations ⚙️

In May, our integrations team added new taps for Invoiced, Dynamics (NAV) on-premise, Altium (Nexar). Additionally, we added new targets for Sage 50 UK, PowerBI, Dynamics (NAV) on-premise, Square (unified schema), and Constant Contact.

We also released improvements to the following connectors:

Taps: A (new) Netsuite tap, Xero, Exact, Zendesk, SFTP, Square, Altium, Mixpanel, a (new) Shopify tap, and Zoho CRM.

Targets: Odoo, Exact, Squarespace.

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

Easier exports

The team continued to add improvements to the new hotglue target SDK. For supported connectors like Quickbooks, Xero, Picqer, Salesforce Commerce, and Odoo, you can now:

• Snapshot the IDs of created records automatically, for use in your scripts and debugging.
• Attempt to post every record in your job, and ingest granular error messages about the records that don't go through
• Fail jobs when any record fails, or allow jobs to complete when some records go through (configurable in jobs settings).

Improved widget experiences

Allow your users to create their own field maps, map custom fields, and manage complex integrations more simply with new widget improvements:

• Display nested fields in the custom field mapping widget, so that you can support more complex use cases like addresses and complex API structures.
• Offer a simpler field map (selection) experience, with click-to-select and granular filtering on the tables and fields you display.
• Use selectors to allow users to define auth regions for Zoho and specify tenants for Xero.

We also added a few more goodies, including:

• New environment variables, unified schemas, triggers, and API endpoints
• New unified schema mappings
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• A new hub for docs and help articles in your dashboard
• A fresh face for subtenant experiences in the widget
• Faster Jupyter load times

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

New integrations ⚙️

In May, our integrations team added new taps for Amazon Vendor Central, Azure Active Directory, and Squarespace. Additionally, we added new targets for Etsy, Exact, and Picqer.

We also released improvements to the following connectors:

Taps: Salesforce, Zoho CRM, Stripe, Marketplacer, S3, Square, Stamped, Quickbooks, and SFTP.

Targets: Xero, Montapacking, Moosend, Quickbooks, and SFTP.

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

• Heap integration
• Dynamic control over widget fields, dropdowns, and toggles using your embed code
• Granular settings to run full syncs by default for specific tenants
• CLI improvements, including a new command to check for tenants with forked ETLs
• Hard deletes on schedules
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• A more intuitive widget experience, including a simpler field map, nested mappings, and performance optimizations
• Enhanced alerting and snapshotting capabilities in the new hotglue target SDK
• New environment variables, unified schemas, triggers, and API endpoints 👀

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt! Here's what you may have missed:

New integrations ⚙️

In April, our integrations team added new taps for Etsy (unified API schema) and Bol. We also added new targets for Marketplacer (unified API schema), Redshift, and Salesforce Commerce Cloud.

We also released improvements to the following connectors:

Taps: Montapacking, BigCommerce, QLS, Amazon Seller Central, Looker, Stripe, Ongoing WMS, Abra, Apple App Store,

Targets: Prestashop, Salesforce Sandbox, Campaign Monitor, Quickbooks, Postgres, SFTP

See the full list →

New features and improvements 🔨

Outside of new connectors, the frontend and backend teams made several improvements including:

A cleaner dashboard experience

• Use our new filters in the jobs table to find specific jobs (and issues) quickly.
• Our new-and-improved in-app alerts give you more context about specific errors. The're also prettier 😊

Better job webhooks

• Webhooks are now configurable per tenant. If that's your thing, you can do that now.
• Job webhooks are also wrapped in generous backoffs, retries, and logging, if you struggle with instabilities in your webhook endpoint.

Flow-level configuration

• We added more configurability on a flow-level, such as the ability to always run full syncs or limit visibility for specific flows.
• We added improvements to V2 (bi-directional) flows, including the ability to map custom fields for exports and link multiple connectors.

Next up 📈

Here are some things to look forward to in the next updates:

• Integrate your jobs data with Heap!
• Dynamically control widget parameters from your frontend
• Improvements to the field map, mapping, and linking experiences inside the widget

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Environment variables 👩‍💻

You can now add and configure global environment variables to use inside your ETL scripts. For new customers, default scripts include support for EXPORT_FORMAT.

You can also use any custom variables that you need, like private keys, environment names, or API endpoints.

Environment variables are configurable in your settings, under variables. You can create as many variables as you need.

New integrations ⚙️

In March, our integrations team added new taps for Abra, Affinity, Apple App Store, Chargify, Faire, Gladly,Marketplacer, and Picqer. Additionally, we added new targets for Affinity, Klaviyo, and Campaign Monitor.

We also released improvements to the following connectors:

Taps: Exact, Salesforce, Looker, Amazon Seller, Bigcommerce, Quickbooks, Hubspot, Salesforce Commerce, and Pipedrive

Targets: Postgres, Quickbooks, Google Sheets, and Pipedrive

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

• New unified schema tables for accounting integrations
• Slack integration for failed job alerts
• Faster load times for Jupyter notebooks
• Optimized parquet format usage
• Updated language across the dashboard
• Static IP support for job webhooks
• Error message parsing for failed discovers
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• More tools to manage logs and understand failed jobs ⁠⁠

• Expanded support for target states, which means detailed information about records you create in external systems

• ⁠UI improvements to the Tenant and All Jobs page

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

New bi-directional flows 🔃

We're excited to announce a new way to set up your flows. Instead of connecting to "sources" or "targets," your users can now connect to any available "connector" in the dashboard and run jobs both ways for that tenant.

Bi-directional flows are enabled by default for new users. Let us know if you're already using hotglue and want to try out these new flows.

Subtenants in the widget 🤝

Also released this past month, you can now create multiple connections to the same connector using "subtenants." This can be used for customers with multiple shops, or parent companies with multiple business entities.

You can turn on subtenants in the widget settings.

New integrations ⚙️

In February, our integrations team added new taps for Salesloft and Salesforce Commerce. Additionally, we added new targets for Clickup, Jira, Google Cloud SQL (Postgres), Blackbaud, and QLS.

We also released support for new triggers for Salesforce and Quickbooks

We also released improvements to the following connectors:

Taps: Sage 50 UK, Amazon Seller, Outreach, Montapacking, Salesforce Sandbox, Shopify, Zoho Books, Woocommerce, BigCommerce, Hubspot, BigCommerce

Targets: Xero, Quickbooks Desktop, Quickbooks Online, netoHQ, Snowflake

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

• A new "All Jobs" table to review and filter recent jobs across all tenants
• Parquet output file type to preserve primary keys and typing
• Support for mapping CSVs inside the widget
• Added a promise when the widget is mounted
• Configure automatic initial syncs on a flow level
• Improved UI for creating default tenant jobs
• Resolved stalled jobs bug
• Expanded support for unified schemas
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• Extended tenant management and monitoring tools
• Revamped targets with granular logging, straightforward documentation, and expanded support for updating records
• Job monitoring with Slack and Heap

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

New tenant drawer 👥

With the new tenant drawer, you can now access metadata, schedules, job history, snapshots, and more straight from the dashboard. This gives you fine-grained visibility into tenant configurations without having to touch the API.

We will use this in the future to offer detailed filters, sorting, and analytics on your catalog of tenants. Let us know what sort of metadata you'd like to filter and sort your tenants with!

New integrations ⚙️

In January, our integrations team added new taps for QLS, GoHighLevel, and Shiphero. Additionally, we added new targets for Gong, Pipedrive, Wix, and Quickbooks Desktop.

We also released support for new triggers for Pipedrive, Salesforce, and GoHighLevel.

We also released improvements to the following connectors:

Taps: Hubspot, Dynamics, Netsuite, Chargebee, Wix, Stripe, Google Sheets, Amazon Seller, Quickbooks, Dynamics, and plentymarkets

Targets: Mailchimp and Moosend

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

• Improved field map selection UI
• Added support for receiving webhooks from your system
• Added more granular details in job webhooks
• Faster field map refreshes
• Re-built static IP feature for improved performance and stability
• Optimized performance for deleting and modifying objects
• Improved job failure emails
• Improved hotglue widget whitelabeling
• Expanded support for unified schemas and real-time triggers
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• Bi-directional flows, allowing you to read and write data to the same connectors in a single flow
• Native sub-tenant support in the widget
• A new global jobs table to manage and filter jobs across tenants

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Connector Roadmap 🛣

Have a new integration you need for your product? Instead of building it yourself, you can use our connector roadmap to request it. We'll add it to our roadmap, and once it's built we'll reach out to you.

If the connector is already on our roadmap, you can use this page to upvote it and get it built faster!

New integrations ⚙️

In December, our integrations team added new taps for Google Analytics UA, Capsule CRM, Keap, FollowUpBoss, PowerBI, Montapacking, Fortnox, and Kustomer. Additionally, we added new targets for Quickbooks Sandbox, Odoo, and Montapacking.

We also released support for triggers for Shopify, CapsuleCRM, Keap, FollowUpBoss, Zendesk, and Pipedrive.

We also released improvements to the following connectors:

Taps: Intacct, Asana, Hubspot, Woocommerce, Xero, Chargebee, Amazon Seller, Plentymarkets

Targets: Shopify, NetSuite, Woocommerce

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

• A toggle to avoid syncing historical data on the first sync
• Ability to set the start date for linked sources via API
• Ability to configure custom callback URIs
• Optionally remove state from webhooks to keep data clean
• Configurable increased job memory for individual tenants
• Expanded support for unified schemas and real-time triggers
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• New access to tenant metadata--including configs, schedules, and custom metadata--directly from the dashboard
• Enhanced widget whitelabelling and customization
• Expanded support for unified schemas and real-time triggers

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Unified Schemas 📖

We have added the ability to enable and use our Unified Schemas for CRM, Accounting, and E-Commerce integrations directly inside the hotglue admin panel.

Simply enable the Unified Schema toggle in your source settings, and choose the relevant tables. All data will come through in our unified schema rather than the raw source schema.

We are working on expanding the connectors that support unified schemas and what tables we support – let us know if you are interested in using this feature!

New integrations ⚙️

In November, our integrations team added new taps for Copper, AgileCRM, Sellsy, PlentyMarkets. Additionally, we added a new unified schema target for Zoho.

We also released support for triggers for QuickBooks, Shopify, and WooCommerce

We also released improvements to the following connectors:

Taps: Salesforce, QuickBooks, Chargebee, HubSpot, Amazon Seller, CIN7, Google Analytics, SFTP

Targets: BigQuery, Snowflake, WooCommerce

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• Shipped support for OAuth 1 connectors such as Magento 1
• Added option to automatically trigger a sync when a new integration is linked
• Added option to set hourly sync schedules in admin UI
• Added option to manually link a tenant in the admin dashboard
• Improved error handling and validation on API calls
• Improved stability of job rollbacks
• Added automatic detection of jobs that failed due to invalid credentials
• Allow overriding widget options for specific flows
• Added ability for users to request new connectors
• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• Improved performance for refreshing catalogs for sources
• Expanded support for unified schemas and real-time triggers
• Ability to connect multiple accounts from the same integration (for example, allow tenants to connect multiple Shopify stores in the widget)
• A new home for the unified schemas documentation and examples

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Real-time Job Triggers ⚡

We have officially launched support for real-time triggers for several integrations, including: Salesforce, HubSpot, and Shopify. Triggers allow you to automatically run sync jobs when something happens in a source system. For example, as soon as a new contact is created in HubSpot or Salesforce, hotglue will receive a webhook on your behalf, and trigger a job.

We are rapidly expanding support based on demand – let us know if there are any you are interested in!

Mapping in the Widget 🔌

We have added support for allowing tenants to do simple mappings of their data in the widget. This works for both source flows, where you want tenants to map to your own data schema (for example, a tenant could map a custom Salesforce object to your Contact schema), and for target flows, where you want tenants to map their data in your product to a target.

To learn more or try this beta feature, reach out to us at hello@hotglue.xyz. Public documentation is coming soon!

Detailed Job Metrics 📊

While sync jobs run, hotglue will automatically track the number of records collected for every stream in real time. This allows you to have more visibility into a particular sync and its progress! This data is also made available via the API. See a sample below:

New integrations ⚙️

In September, our integrations team added new taps for FTP, MooSend, PostHog, MySQL, Jotform, and Sellsy. Additionally, we added new unified schema targets for MooSend, WooCommerce, ActiveCampaign, Sage Intacct, and Dynamics 365 Business Central.

We also released improvements to the following connectors:

Taps: HubSpot, NetSuite, Dynamics 365 Business Central, QuickBooks

Targets: BigQuery, NetSuite

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• Updated job metric graphs in environment dashboard. New graphs show failing jobs, record counts, and more!

• Added new setup guide for new users, which includes videos and guides explaining hotglue concepts. You can always launch the setup guide via the Environment Settings.

• Launched new landing pages describing our unified schema features!

  • Also updated footer to include more categories from our integrations library

• Added ability to Clone Flows to other environments

• Added ability to store a "snapshot" of reference data required for targets to optimize their runtime. Currently available for target NetSuite, and will be coming to other targets soon!

• Updated notification emails for improved look & feel

  • Job failure alerts will now include summary error messages to provide more information

• Added option to allow tenants to trigger full sync jobs in the widget

• Updated JupyterLab connections to use SSL

• Made source catalog available during ETL runtime

• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• Option to use Unified Schemas directly inside hotglue
• Ability to connect multiple accounts from the same integration (for example, allow tenants to connect multiple Shopify stores in the widget)
• Support for OAuth 1 integrations

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

New Scheduler Service 🗓️

We have updated our scheduler for triggering jobs to handle the higher volume of scheduled jobs we are seeing.

Note: As a part of this change, we have moved away from AWS EventBridge cron expressions to standard UNIX cron expressions. You will receive email alerts if any of the cron expressions you are using cannot be automatically converted to the new format.

New integrations ⚙️

In August, our integrations team added new taps for Sage 50 UK, Dynamics 365 Finance & Operations, Mailstep, and Notion. Additionally, we added new unified schema targets for Dynamics 365 Sales and Shopify.

We also released improvements to the following connectors:

Taps: HubSpot, Google Analytics, WooCommerce, Magento, Chargebee, QuickBooks, and Prestashop

Targets: Salesforce, NetSuite

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• Updated billing functionality

  • You can now view your active tenant usage and manage your hotglue subscription from directly within your Account Settings!
  • Automatic warning alerts will be emailed to your hotglue org members as you reach active tenant limits

• Download Job service has been updated to allow you to download cached data from larger jobs (up to 20GB)

• hotglue widget updates

  • Added support for localization
  • Added new option to hide back buttons when using HotGlue.link function
  • Added flag to allow tenants to link multiple sources in a single flow
  • Fixed bugs in scheduling UI

• Added ability to retrigger failed jobs without rerunning the SYNC phase. This is mainly used for testing/updating ETL scripts.

• The UI for refreshing field maps for taps has been updated:

  • While refreshing, the field map will be inaccessible and show that it is being refreshed in the backend
  • Added visibility into logs of the refresh field map process (we call this a discover) in case of issues

• General bug fixes and stability improvements

  • We suffered a major AWS outage in our region (us-east-1), but were able to avoid an extended outage by switching to the us-west-1 region. To stay updated on outages like this, subscribe to our status page updates.

Next up 📈

Here are some things to look forward to in the next updates:

• Mapping in the widget
• Real-time triggers for sync jobs
• Job Metrics for both past & running jobs

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our sixth hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Updated Landing Pages 🎨

We have updated our landing pages to more closely match our brand and explain the possible use-cases for hotglue. This includes an interactive preview of the new hotglue widget, more emphasis on the developer experience, updated graphics, and more. See a preview below:

Updated integrations ⚙️

In July, our integrations team focused on expanding our unified schemas and library of targets (integrations that push data to other platforms). Notably we have released new versions of targets that use the unified schemas: Salesforce, HubSpot, Xero, and NetSuite.

Additionally, we have released new Magento v1, Wix, GitHub, and Stripe taps that feature better performance and data models. We also released improvements to the Facebook Ads, Amazon Seller, Prestashop, Chargebee, HubSpot, Magento, and Zendesk taps.

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• Added support for the gluestick to_singer function to enhance support for typing and setting primary keys when pushing data to targets

• Added support for using both etl.py and etl.ipynb formats for ETL scripts

• @hotglue/widget package updates

  • Added a hideFlows option to hide flow containers in the Connections component
  • Added class names to customize styling on the Connections component
  • Updated text under Quick Actions section in widget
  • Fixed compatibility issues with NextJS
  • Fixed bugs with unlinking connected integrations

• Added command to delete deployed ETL scripts to hotglue CLI

• Fixed timeout issues when downloading long job logs

• Added optional upsert option to toggle sync schedule endpoint to apply default schedule to all tenants

• General bug fixes and stability improvements

  • Fixed issue with flow icons being expired/disappearing
  • Added error message to explain when OAuth window pop-up is blocked
  • Improved error message detection logic in jobs

Next up 📈

Here are some things to look forward to in the next updates:

• Mapping in the widget
• Real-time triggers for sync jobs
• Job Metrics for both past & running jobs

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our fifth hotglue melt - we have got some awesome updates to share!

Our Team 🤝

In June we welcomed Davi, an awesome full stack engineer, to our team! We are super pumped to have him join us and help the product reach the next level.

Product Updates 🚀

React component + npm package 🎨

We have released the new hotglue widget as an npm package to make the setup process more streamlined. Part of this change includes a totally overhauled Connections React component, an inline version of the hotglue widget. The goal of the Connections component is to allow for a more native user experience for tenants. See an example below:

You can learn more about the widget, React component, and the new installation process in the docs: https://docs.hotglue.com/docs/embed-hotglue

Note: The old Connections component was previously available in the now deprecated hotglue-elements package.

Revamped Google Sheets integration 🤩

As mentioned in our last update, one of our goals this month was to revamp the Google Sheets integration. We have vastly simplified the user experience for tenants that are connecting their Google Sheets. Beyond that, the new version of the integration also reduces the amount of setup required.

The new Google Sheets integration is already available for use, and we would love any feedback or suggestions you have! Feel free to reach out at hello@hotglue.xyz

New integrations ⚙️

As usual, our integrations team added more integrations – notable ones include Google Workspace, Fishbowl Inventory, Gong, Delighted, Google Play Store, Front, Metronome, and iTunes Connect. We also released improvements to the HubSpot, WooCommerce, Salesforce, Iterable, Chargebee, Snowflake, and more.

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• Resolved issues with downloading large jobs directly from the hotglue admin panel!

• Improvements to job logging:

  • Cleaned up the logging of exceptions in failing jobs to make them more readable
  • Added a section in admin panel to see a summarized log of why a job failed
  • Added an error field to the job details returned from the API including the summary log of why the job failed

• Added the option to enable a Job History tab in the widget, so tenants have visibility into the sync jobs that have run. See below:

  

• Added PATCH endpoint to allow updating the tenant config. Read more in the docs

• Added revoke parameter to DELETE tenant endpoint which deauthorizes any active OAuth connections before deleting the tenant. Read more in the docs

• You can now choose a color to easily identify your hotglue environments in the admin panel, and update their names.

• Enabled ability to override the default scopes for the HubSpot connectors in the admin panel

• General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

• Unified schemas
• Mapping in the widget
• Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our fourth hotglue melt - we have got some awesome updates to share!

Our Team 🤝

As some of you may know, the hotglue team is fully remote with members from the United States, Brazil, Pakistan, and the Philippines. We recently had our first company meetup in São Paulo, Brazil – home to our amazing frontend engineer, Breno!

We wanted to share our first team picture (with everyone wearing their new hotglue swag 😎) from the trip with all of you. None of this would be possible without your support, and we are excited to continue our mission to make building native integrations simpler.

Product Updates 🚀

Redesigned Widget 🤩

As mentioned in our last update, our product team has been hard at work on a new version of the hotglue widget. Our goals were to radically enhance the UI to give a more intuitive experience for users and deliver a polished interface. Beyond that, we are focusing on increasing the customizability of the widget so you have more control over your users integration experience.

The new widget is already available for use! You can learn how to upgrade on our docs.

We would love any feedback and suggestions you have! Feel free to reach out at at hello@hotglue.xyz

New integrations ⚙️

As usual, our integrations team added more integrations – notable ones include SKUVault, SFTP Files, and Zendesk. We also released improvements to the Amazon Seller, Chargebee, Magento, Unleashed, Bexio, Pipedrive, HubSpot Beta, and Fulfil integrations.

Note: We are advising all users of our HubSpot integration to upgrade to our new connector (labeled HubSpot (B) in the hotglue UI). The new connector features performance improvements and a data model that is much easier to work with. If you have any questions, please reach out to us!

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• hotglue now integrates with Datadog! You can configure hotglue to push job events (success or failures) directly to your Datadog events to maintain observability in one platform. Learn more in the docs.

• We have developed an improved SFTP integration (called SFTP Files), allows users to browse their SFTP server and select the files/directories they want to clone! See a preview below:

  

• You can now use your own S3 buckets to cache job data and snapshots! If you're interested in trying this feature, contact us to help you get it setup :)

Next up 📈

Here are some things to look forward to in the next updates:

• Improvements to our embeddable UI

  • Ability to install widget via npm
  • Updated React component with better performance and customizability

• Improved Google Sheets integration

• Unified schemas

• Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our third hotglue melt - we have got some awesome updates for you all.

Product 🚀

Redesigned UI 🤩

Our product team is extremely excited to launch a redesign of the hotglue admin panel! The goal of the redesign was to create a more polished UI with a more intuitive UX. We would love feedback from users as they try it out!

New integrations ⚙️

In April, our integrations team added a whopping 27 new integrations! The most notable are:

• RingCentral
• Freshcaller
• Snowflake
• Outreach
• Zuora
• Amplitude
• Intercom
• BigCommerce
• Shipbob
• Fulfil.io
• Ordoro
• Ecwid
• Exact Online
• NetoHQ
• Vilkas
• Wannafind
• Dear Systems
• Abicart

See the full list →

Bug fixes and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

• Overall API performance improvements
• Added endpoint and option in admin panel to force kill jobs. See the docs.
• Added option to save snapshots even if jobs fail
• Improved job queue times (now they start faster!)

Next up 📈

Here are some things to look forward to in the next updates:

• hotglue widget v2
• Unified schemas
• Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

Welcome to our second hotglue melt - we have got some awesome updates for you all.

Security 🔒

In March, we received our official SOC 2 Type II certification! Data security and privacy is an essential component of our dedication to upholding our promise to protect sensitive user data. As we continue to grow as a company, our commitment to security remains steadfast.

Read more →

Product 🚀

New integrations ⚙️

Last month, we added 7 new integrations! The most notable are our new Bexio, Amazon Seller, and Freshsales integrations. We've also released updates for our NetSuite, Chargebee, Zoho, and Prestashop integrations, among others.

Read more →

New features and improvements 🔨

The product team did some amazing work during March. Here is what they did:

• Created new daily tenant report to see failing jobs by tenant (you can enable in your settings)
• Added option to enable error notifications for all failing jobs (used to just be for scheduled jobs)
• Added option to automatically rollback failed jobs
• Jupyter workspace will now notify you when it becomes inactive (instead of a silent shutdown)

Next up 📈

Here are some things to look forward to in the next updates:

• A brand new look for hotglue 👀
• Unified schemas
• Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋

Hi hotgluers!

As we grow, we want to make sure that we share our progress with everyone that has helped get us here, and are continuing to help us grow.

Our Team 🤝

Our team is now at 11 people! In February we welcomed Paul, an awesome UI/UX designer, to our team – welcome aboard 🛳

We also want to give a shoutout to the integration team for adding 22 new integrations last month, which is a record for us!

Product 🚀

New integrations ⚙️

Last month, we added 22 new integrations! The most notable are our new SAP S/4HANA, MongoDB, and Dynamics Business Central integrations. We've also released updates for our NetSuite, Shopify, Stripe, and Salesforce integrations, among others.

Read more →

New features and improvements 🔨

We also have a lot of new fantastic features and improvements that we rolled out last month. Here they are:

• The first edition of the hotglue CLI 🎉
• Improved speed and stability of registration
• Added ability for tenants to edit their field map in the widget
• Added support for longer job history list
• Updated integrations pages
• Improved stability of provisioning jobs
• Added the ability to filter flows in the hotglue-elements React component
• Added an endpoint to apply sync schedule changes to all tenants

Next up 📈

Here are some things to look forward to in the next updates:

• Updated dashboard that provides more insight on the jobs being run in each environment
• Faster HubSpot tap
• UI improvements
• Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋