Changelog

hotglue melt: April 2024

May 2nd 2024

Welcome to our April Melt! Here’s what you may have missed from the past month.

New Connectors ⛓️

Melt - Dark (2).png

We added 5 new integrations to our library and the open-source Singer community in April.

Logic4

Keyna from our integrations team built a tap and target for Logic4 (logic4.nl), an e-commerce and ERP platform based in the Netherlands. You can use the connectors to fetch inventory, purchase, and sales information, and write back transactions like purchase orders.

Bird (formerly MessageBird)

Keyna built a target for Bird (bird.com), an omnichannel communications platform and CRM. Built on Hotglue’s target SDK, the target lets you push any data, like new contacts, to your customers’ Bird CRM accounts.

Appsflyer

Adil from our integrations team built a target for Appsflyer (appsflyer.com), a mobile marketing analytics tool. Combined with our existing Appsflyer tap, the new target allows you to offer bi-directional connectivity with your customers’ Appsflyer apps.

Connectwise

Our partner, Plentive, built a connector to read data from Connectwise (connectwise.com), an MSP management solution. The tap fetches data such as projects, activities, and time entries.

ClientTether

Chauncy from Plentive also built a connector for ClientTether (clienttether.com), a CRM for franchises. The connector fetches general CRM data from your customers’ ClientTether accounts.

We also released a Confluence connector out of beta, thanks to a fork of Edgar Ramírez Mondragón’s Singer tap.

New API endpoints 🚥

We released two new API endpoints last month.

catalog/search

Run fast, granular searches across catalogs to search for streams, fetch types, and more. This is particularly useful for large catalogs that are too big to be served in a single linkedSource fetch.

discover/kill

Just like the Kill Jobs endpoint, you can use this to end any running discovers for a linked connection.

Job log quality of life updates 🔁

You may also notice some minor QoL updates to your log viewing experience:

  • Logs now open with the erroring section loaded, rather than the first line of the log
  • We added new navigation pills to quickly skip between the sync, ETL, and export sections
  • Logs are now clickable as soon as jobs kick off

Job-level environment variable control ✅

You have more control than ever over the behavior that your jobs run with.

POST /jobs

When making a POST to `/jobs`, you can define override environment variables. This could be an existing reserved variable (max_record_count, default_export_format) or a custom environment variable used in your ETL.

Schedules

When setting schedules, you can now configure schedules to run with specific environment variables and job settings, just like manual job runs. Supported params in schedules now include:

  • override_start_date
  • override_selected_tables
  • override_field_map
  • environment_variables

Got questions, or have requests you’d like to see us build? Reach out to us in Slack or at hello@hotglue.xyz.

See you next month 🙂

- Brendan


hotglue melt: March 2024

Apr 4th 2024

Hey hotgluers,

Welcome to the hotglue melt.

Before we jump into what’s new in hotglue, we have a few major updates that we are slowly rolling out in a limited beta.

Real-time writes remove the need for a job process to POST data using our unified API. If you use our API to write data (not a reverse ETL from a Database or filestore), this lets you see the validations or success responses right when you POST. The limited beta is for Quickbooks and Shopify, with more to come with the general release.

Thereal-time webhook handler runs high-throughput trigger-based workflows without the need for full job processes. This is built on top of our real-time triggers–now they are just much faster, smaller, and more flexible.

If these are relevant to you, and you want to try them out before general release, let us know!

Reach out to us at hello@hotglue.xyz

Now, for what’s new:

Connector-level schedules 🗓️

Schedule-1.png

With connector-level schedules, you can maintain individual schedules for each connector - either as an alternative or an addition to existing flow-level schedules. This enables use cases like:

  • Running multiple schedules for the same connection, like an hourly sync and a weekly catch-all.
  • Building automations to pause and re-enable certain integrations.

Updated email notification system 📢

Updated-Email-v1-min.png

If you use emails to track job failures, you may have noticed some changes to the emails you get:

  • You can now configure email notifications on an environment-level, rather than across all environments. Environment-level emails can be configured in Settings > Notifications, while Organization-level emails remain in your account settings.
  • Daily report emails now display the error messages and their associated tenants, rather than a list of failing tenants. This should make it easier to track error patterns without needing to navigate your hotglue admin panel.

Other features 🚀

  • **Restrict upload file types in the widget.
    **In Settings > Widget, you can now configure a list of supported file types for file uploads. Use this to only allow discoverable files (csv and excel), or otherwise limit uploads to files that your ETL is prepared to handle.

  • **Jupyter speed boost
    **Your environment and script-level dependencies are now downloaded and cached the first time you run Jupyter. That means that subsequent Jupyter startup times are significantly faster now.

  • **Memory failure auto-retriggers
    **Large jobs occasionally need more memory and storage than is provisioned by default. In Settings > Jobs > Error management, you can now configure jobs to automatically retrigger with increased memory on OOM failures.

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: February 2024

Apr 3rd 2024

Hey everyone! Welcome to our monthly hotglue melt. Here’s a rundown of the hotglue features you may have missed.

Faster jobs

image (2).png

Over the past few weeks, our backend team has pushed some big changes to help make jobs faster. We’ve seen job time savings of anywhere from 40 seconds to over 3 minutes, and there’s more to come. The improvements to date include:

  • ETL Dependency Caching: Jobs now only update and install ETL dependencies when necessary.
  • Asynchronous Job Status Webhooks: Jobs no longer wait for webhook responses. If your webhook endpoint takes a while to respond, you’ll notice big gains here.
  • Dynamic Installation of Database Drivers: hotglue now intelligently installs database drivers, only when required.
  • Refined Python Venv Inits: We’ve refactored how we initialize virtual environments, to remove unnecessary overhead from the runtime.

Next steps: We’re working through individual connectors to add more concurrency, and adding some additional optimizations to the job executor.

Redesigned on-premise connectors (Sage 50 UK and Quickbooks Desktop)

image (1).png

Sage 50 UK and Quickbooks Desktop are installed executables available on our Basic Plan and above. They can now be linked in under a minute and managed remotely, with:

  • JWT-secured password authentication
  • Remote logging
  • Auto-updates with the hotglue launcher
  • Remote config and state management

Here’s a demo of how this works for QBD.

New Integrations 🔁

Melt - Dark.png

Over the past few weeks, our integrations team contributed three new connectors to hotglue’s library and the Singer community:

  • Linnworks (tap), built by Vinnie
  • Precoro (target), built by Keyna
  • Sellercloud (tap), built by Adil

Our customer Plentive also contributed four new Singer connectors, which are all available to use in any hotglue environment:

  • BQE
  • VantagePoint
  • Quickbooks Time
  • Crelate

Lastly, we improved some existing open-source connectors and added them to the hotglue library:

  • Redshift (tap), originally built by Monad
  • LinkedIn Ads (tap), originally built by Singer.io
  • Clickhouse (target), originally built by Shaped.ai

Fixes and improvements 🛠️

Frontend:

  • The billing page now shows your invoices for download, and you can assign billing page access to multiple user accounts
  • The job download process runs faster now, and no longer requires pop-ups to be enabled.
  • You can now “clone” connectors across the same environment
  • Jupyter notebooks run on Python 3.10 if you use our V3 job executor.
  • The widget custom mapping tab text can now be customized

Jobs and stability:

  • A new environment setting to retrigger jobs automatically when they hit memory limits

  • When a catalog’s size surpasses AWS API Gateway’s max limits, it is now trimmed to a “lite” version in API responses. The full catalog is still used by syncs and ETL scripts.

  • Added code coverage and mock classes for Salesforce Apex triggers and classes

  • Google sheets discovery is now up to 12x faster in the widget.

  • We added new CLI functions and API endpoints, including:

    • CLI: `hotglue tenants custom-etl` to find tenants with forked ETLs
    • API: `PATCH /linkedConnectors` for updating v2 flow configs

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: 2023 Feature Roundup

Apr 3rd 2024

Welcome to our year-in-review 2023 hotglue melt!

To those who’ve been around for a while, thank you for building your integrations on hotglue.

You make hotglue a better product with your feedback, and we’re always excited to see the creative ways you put hotglue to use.

As we begin the new year, we wanted to take a brief moment to look at how hotglue has changed over the last year. As always, feel free to reach out in Slack with your questions and suggestions for 2024!

2023 hotglue in summary 📋

Our integrations team built 83 open-source connectors. That included support for 61 net new SaaS and on-premise applications.

hotglue jobs are now much faster, thanks to a rebuilt runtime and deployment pipeline.

We added new modules across the admin panel, including the Jobs, Errors, White-Label, Connector Settings, and Environment Variables features.

Our new bi-directional flows make reading and writing data with your customers’ integrations dead-simple.

The hotglue team built a new Singer target SDK, making for simple, transparent exports to our most popular SaaS connectors.

Bi-directional flows↔️

V1-2.png

Before 2023, hotglue flows always consisted of a linked source and a linked target. This made for dead-simple setups when you only needed to move data in one direction.

However, bi-directional integrations where you need to consistently read and write data were not simple to set up in hotglue: you needed two separate flows with symlinked credentials.

Now, with hotglue bi-directional “V2” flows, this is supported out of the box. Rather than thinking about target flows, `linkedSources`, and `linkedTargets`, every integration that a customer links in a V2 flow is simply a connector.

Bi-directional flows come with a new set of “V2” endpoints. If you’re not already using V2 flows, you can try them out by creating a new flow, and leaving the “bi-directional” toggle turned on. Let us know if you want to discuss migrating your existing flows over!

New tools in your dashboard🖥️

4 (1).png

In 2023, we pushed some major updates to how you use the hotglue admin panel. You may have noticed the new jobs and errors panels, but there are other features spread through your dashboard that you may find useful:

  • Connector Settingsallows you to define granular settings for your connectors, like the fields exposed in the widget, default config values, and the `install_uri` for custom git branches.
  • Environment variables allow you to add additional variables for you to use in your ETL scripts on the fly, such as API URLs, flags, and keys.
  • The Jobs panel lets you run fine-grained searches for jobs.
  • The Errors panel gives you an overview of the most common errors affecting your tenants.
  • The Tenant Drawer allows you to view and edit settings for your tenant, including the `tenant-config`, tenant metadata like org names, job schedules, and job history.
  • White-label settings lets you customize the OAuth page, including your callback URI, logos, background colors, and loading text.
  • We also added a host of environment settings, including more options for job failure recovery and Slack and Heap job monitoring.

Faster jobs: a new job executor and connector deployment pipeline🕐

V1-1.png

Last year, we frequently heard that you wanted jobs to kick off and run faster. We rebuilt our job runtime from the ground up with that in mind. The new version of the executor has two main benefits:

  1. Faster builds for discovers and jobs - Jobs and discovers spend 60% less time queuing up, which means less time stuck in JOB_STARTED.
  2. More flexibility with python versions - Our V3 executor defaults to Python 3.10. This is now much more customizable if you have specific version requirements.

We also re-designed our connector deployments using Jenkins, which removes dependency installation from the job runtime.

You can check which executor your jobs use by parsing your job status webhooks. If the `task_definition.id` shows `hotglue-executor-v3`, you’re using our modernized architecture!

Hotglue’s new SDK for writing Singer targets🎯

5.png

The main challenge with using Singer targets has historically been understanding which records were created, and where validations happened. Traditional Singer targets either succeed (data probably loaded in) or fail (some data may have been loaded in, but not all of it). Hotglue’s new target SDK is designed to fix this.

The root concept in Hotglue’s target SDK is the `target_state`. The target state contains important data about what the target did, including:

  • How many records were created, updated, or failed to load
  • The success or failure codes for each record, and the new `id` from the target system, if returned.
  • Failure messages for records that didn’t go through

In 2023, we built or upgraded 32 targets using hotglue’s target SDK. If you’re using a target that isn’t on this list yet, let us know! It may already be in our pipeline:

Widget improvements🔧

If you’re not using the widget or not using many widget features, you may have missed the updates we’ve been shipping all year: https://www.npmjs.com/package/@hotglue/widget?activeTab=versions

Note for React users: At the time of writing, the current version of @hotglue/widget is v1.4.46. You may need to update your widget version to access some of these features.

  • Subtenants are now native to the widget, which you can enable in your widget settings. When turned on, your users can link multiple instances of the same integration.
  • Your custom field mappingpage has a host of new features, including required tables and fields, multiple mappings per table, and localization.
  • For those looking for a more custom workflow in the widget, we’ve added many new listeners, filters, and nextStep workflow actions across the widget.
  • You can also now define more widget and connection behavior by passing values directly in your frontend code, including tenant metadata, dynamic OAuth parameters, and localization text.

New connectors🔁

V2.png

We added 61 new integrations in 2023, including 11 brand new bi-directional integrations, 29 new taps, and 21 new targets. We also rebuilt many of our most well-used connectors, which are not listed below.

Accounting and Inventory:

  • Abra (tap)
  • Dynamics NAV on-premise (Bi-directional)
  • Dynamics BC on-premise (Bi-directional)
  • Exact (target)
  • Invoiced (tap)
  • Katana (tap)
  • Microsoft Dynamics BC (target)
  • Nexar (tap)
  • Precoro (Bi-directional)
  • PropX (tap)
  • Quickbooks Desktop (target)
  • Restaurant 365 (Bi-directional)
  • Sage 300 (Bi-directional)
  • Sage 50 UK (target)
  • Zoho Inventory (Bi-directional)

E-commerce and Order Management:

  • Amazon Vendor Central (tap)
  • BigCommerce (target)
  • Bol (tap)
  • Brikl (Bi-directional)
  • Etsy (Bi-directional)
  • Marketplacer (Bi-directional)
  • Picqer (Bi-directional)
  • QLS (Bi-directional)
  • Salesforce Commerce Cloud (Bi-directional)
  • Shiphero (tap)
  • Shipbob (target)
  • Squarespace (Bi-directional)
  • Square (target)
  • Storyous (tap)
  • Toast (tap)
  • Wix (target)

CRM and Email:

  • Affinity (tap)
  • Blackbaud (target)
  • Brevo (target)
  • Campaign Monitor (target)
  • Constant Contact (target)
  • GoHighLevel (tap)
  • Keap (target)
  • Klaviyo (target)
  • Pipedrive (target)
  • Salesforce Marketing Cloud (tap)
  • Salesloft (tap)
  • Sendgrid (target)

Database and Data Storage:

  • Databox (target)
  • Google Cloud SQL (Postgres) (Bi-directional)
  • Microsoft Excel (tap)
  • Microsoft SQL (tap)
  • PowerBI (target)
  • Redshift (target)

Support and Project Management:

  • Clickup (target)
  • Gladly (tap)
  • Gong (target)
  • Jira (target)
  • Livechat (tap)
  • Monday.com (tap)
  • Stella Connect (tap)
  • Zendesk (target)
  • Zendesk Chat (tap)

Other Integrations:

  • Apple App Store (tap)
  • Azure Active Directory (tap)
  • Chargify (tap)
  • Jotform (tap)
  • Trustpilot (tap)

Next up 📈

Thanks so much for reading! These are some things we have coming up:

  • Real-time data posting that enables instant data syncing
  • A brand new ETL experience in the admin panel
  • Faster performance across the product
  • Big updates to hotglue's on-premise connectors

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: September 2023

Sep 1st 2023

Hi team!

Welcome to our monthly hotglue melt. Here are some highlights you might have missed:

  • A fresh "Errors" page in your dashboard - Gain visibility into recurring issues across your jobs, and triage across tenants. With the new errors page, you can catch persistent errors earlier and debug faster.

Screen Shot 2023-09-19 at 1.39.34 AM.png

  • 📁 Upload your scripts directly in hotglue - Skip Jupyter or our CLI, and upload your scripts directly to hotglue. You can add scripts to default tenant to set a new default, or to a specific tenant to make deep customizations.
  • 🤫 New callback white-labeling settings - Looking for ways to make your OAuth experience cleaner? You can now change the background color and toggle off the loading text for a crisp callback page. As always, you can still add your own loading gif, or go a step further with a white-labeled URL and favicon.

New integrations ⚙️

image.png

  • 6 new taps:

    • Salesforce Marketing Cloud: With trigger and API support, you can now connect to your enterprise users' customer engagement metrics, directly to your tech stack.
    • Katana: Import real-time manufacturing data for better inventory management.
    • Microsoft SQL: This popular target is now a hotglue tap as well. Maintain typing and schemas with bi-directional MSSQL integrations.
    • Jotform: Now out of beta. Automatically pull your customers' form submission data into your platform.
    • Trustpilot: Now out of beta. Integrate with customer review data in a few clicks.
    • Precoro: Integrate your clients' procurement data for easier spending analysis.
  • 2 new targets:

    • Databox: An OG. One of our original targets got a facelift.
    • Dynamics BC/NAV (on-premise): The cloud version of our on-prem Dynamics connector brings the same features with the flexibility of the cloud.
  • Credential validation for database connectors, including MySQL, Postgres, and MSSQL.

  • An optimized deployment workflow for lightning-quick in-job installation. Now supported for Dynamics 365 CRM, Woocommerce, and Hubspot.

See the full list →

Quality-of-life improvements 🔨

Outside of our connectors, we made some other quality-of-life features.:

  • Parallelization for /linkedSources and /jobs API calls to improve speed
  • Added new nextSteps and listeners in the widget
  • Even faster load times for Jupyter (down to 2:30)
  • New unified mappings for Pipedrive, Square, and Dynamics
  • Improvements to our cron validator
  • Additional guardrails to prevent password managers from improperly auto-filling connector credentials
  • A new skip_sync option in the /jobs endpoint

Next up 📈

Here are some things to look forward to in the next updates:

  • Improved jobs navigation and state preservation when navigating dashboard jobs
  • New widget features and listeners
  • An easy new way to run write jobs inside the dashboard

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: August 2023

Aug 1st 2023

Hey team!

Welcome to our monthly hotglue melt. Here’s what you might have missed:

  • 😄A simpler UI to add subtenants in the widget - We ditched the widget’s subtenants page for one unified “Connection Settings” panel. Try it out by enabling subtenants in Settings > Widget.
  • ✍️A new hub for docs in your dashboard - Interactive widget embed instructions, API docs, and unified schema references have a new home. Check out the documentation tab on the bottom-left of your navbar!
  • 🤝 Enum mapping in the widget - Want to map general ledger accounts, users, or items? Your users can now map field values in the widget, in addition to the field names they already map. Reach out in Slack for a script to get you started.

New integrations ⚙️

image.png

  • 5 new taps:

    • **Livechat:**Build a feed of your customers’ support conversations and monitor support efficency.
    • **Zendesk Chat:**Access detailed chat logs, user profiles, and support metrics with this bulk connector.
    • **Toast:**Integrate with your users’ operational and sales data using hotglue’s first pure POS integration :)
    • **Sage 300:**Fetch transactions and reference data from your SMB customers’ ERP.
    • **Zoho Inventory:**Extract detailed stock, item, and purchase order details across warehouses and Zoho regions.
  • 3 new targets:

    • Sage 300: Export data directly into your SMB customers’ ERP.
    • **Zoho Inventory:**Push data like bills, vendors, and items to Zoho’s inventory management product.
    • **Sendgrid:**Extend your existing hotglue CRM or email integration with this unified-compatible email integration.

As always, we’re constantly pushing updates to our open-source connectors. You can check out our latest singer connectors or submit a PR at https://gitlab.com/hotglue and https://github.com/hotgluexyz.

See the full list →

Quality-of-life improvements 🔨

Outside of our connectors, we added some other quality-of-life features:

  • A tenant param in the schedule toggle API
  • Bumped the types for the @hotglue/widget package
  • A setting to skip syncs on “trigger” jobs
  • New unified schema models and mappings
  • More credential validations in the widget and API

Next up 📈

Here are some things to look forward to in the next updates:

  • Fresh callback page customizations
  • A unified “Errors” page to track common failures across your tenants.
  • One-click uploads of ETL files in your dashboard.

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: July 2023

Jul 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

New integrations ⚙️

image.png

In June, our integrations team added new taps for Invoiced, Dynamics (NAV) on-premise, Altium (Nexar). Additionally, we added new targets for Sage 50 UK, PowerBI, Dynamics (NAV) on-premise, Square (unified schema), and Constant Contact.

We also released improvements to the following connectors:

Taps: A (new) Netsuite tap, Xero, Exact, Zendesk, SFTP, Square, Altium, Mixpanel, a (new) Shopify tap, and Zoho CRM.

Targets: Odoo, Exact, Squarespace.

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

Easier exports

The team continued to add improvements to the new hotglue target SDK. For supported connectors like Quickbooks, Xero, Picqer, Salesforce Commerce, and Odoo, you can now:

  • Snapshot the IDs of created records automatically, for use in your scripts and debugging.
  • Attempt to post every record in your job, and ingest granular error messages about the records that don't go through
  • Fail jobs when any record fails, or allow jobs to complete when some records go through (configurable in jobs settings).

Improved widget experiences

Allow your users to create their own field maps, map custom fields, and manage complex integrations more simply with new widget improvements:

  • Display nested fields in the custom field mapping widget, so that you can support more complex use cases like addresses and complex API structures.
  • Offer a simpler field map (selection) experience, with click-to-select and granular filtering on the tables and fields you display.
  • Use selectors to allow users to define auth regions for Zoho and specify tenants for Xero.

We also added a few more goodies, including:

  • New environment variables, unified schemas, triggers, and API endpoints
  • New unified schema mappings
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • A new hub for docs and help articles in your dashboard
  • A fresh face for subtenant experiences in the widget
  • Faster Jupyter load times

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: June 2023

Jun 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

New integrations ⚙️

image.png

In May, our integrations team added new taps for Amazon Vendor Central, Azure Active Directory, and Squarespace. Additionally, we added new targets for Etsy, Exact, and Picqer.

We also released improvements to the following connectors:

Taps: Salesforce, Zoho CRM, Stripe, Marketplacer, S3, Square, Stamped, Quickbooks, and SFTP.

Targets: Xero, Montapacking, Moosend, Quickbooks, and SFTP.

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

  • Heap integration
  • Dynamic control over widget fields, dropdowns, and toggles using your embed code
  • Granular settings to run full syncs by default for specific tenants
  • CLI improvements, including a new command to check for tenants with forked ETLs
  • Hard deletes on schedules
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • A more intuitive widget experience, including a simpler field map, nested mappings, and performance optimizations
  • Enhanced alerting and snapshotting capabilities in the new hotglue target SDK
  • New environment variables, unified schemas, triggers, and API endpoints 👀

Got ideas? Shoot us a message in Slack or send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: May 2023

May 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt! Here's what you may have missed:

New integrations ⚙️

image.png

In April, our integrations team added new taps for Etsy (unified API schema) and Bol. We also added new targets for Marketplacer (unified API schema), Redshift, and Salesforce Commerce Cloud.

We also released improvements to the following connectors:

Taps: Montapacking, BigCommerce, QLS, Amazon Seller Central, Looker, Stripe, Ongoing WMS, Abra, Apple App Store,

Targets: Prestashop, Salesforce Sandbox, Campaign Monitor, Quickbooks, Postgres, SFTP

See the full list →

New features and improvements 🔨

Outside of new connectors, the frontend and backend teams made several improvements including:

A cleaner dashboard experience

  • Use our new filters in the jobs table to find specific jobs (and issues) quickly.
  • Our new-and-improved in-app alerts give you more context about specific errors. The're also prettier 😊

Better job webhooks

  • Webhooks are now configurable per tenant. If that's your thing, you can do that now.
  • Job webhooks are also wrapped in generous backoffs, retries, and logging, if you struggle with instabilities in your webhook endpoint.

Flow-level configuration

  • We added more configurability on a flow-level, such as the ability to always run full syncs or limit visibility for specific flows.
  • We added improvements to V2 (bi-directional) flows, including the ability to map custom fields for exports and link multiple connectors.

Next up 📈

Here are some things to look forward to in the next updates:

  • Integrate your jobs data with Heap!
  • Dynamically control widget parameters from your frontend
  • Improvements to the field map, mapping, and linking experiences inside the widget

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: April 2023

Apr 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Environment variables 👩‍💻

You can now add and configure global environment variables to use inside your ETL scripts. For new customers, default scripts include support for DEFAULT_EXPORT_FORMAT.

You can also use any custom variables that you need, like private keys, environment names, or API endpoints.

Screen Shot 2023-04-09 at 9.28.09 PM.png

Environment variables are configurable in your settings, under variables. You can create as many variables as you need.

Screen Shot 2023-04-09 at 9.28.14 PM.png

New integrations ⚙️

image.png

In March, our integrations team added new taps for Abra, Affinity, Apple App Store, Chargify, Faire, Gladly,Marketplacer, and Picqer. Additionally, we added new targets for Affinity, Klaviyo, and Campaign Monitor.

We also released improvements to the following connectors:

Taps: Exact, Salesforce, Looker, Amazon Seller, Bigcommerce, Quickbooks, Hubspot, Salesforce Commerce, and Pipedrive

Targets: Postgres, Quickbooks, Google Sheets, and Pipedrive

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

  • New unified schema tables for accounting integrations
  • Slack integration for failed job alerts
  • Faster load times for Jupyter notebooks
  • Optimized parquet format usage
  • Updated language across the dashboard
  • Static IP support for job webhooks
  • Error message parsing for failed discovers
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • More tools to manage logs and understand failed jobs ⁠⁠

  • Expanded support for target states, which means detailed information about records you create in external systems

  • ⁠UI improvements to the Tenant and All Jobs page

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: March 2023

Mar 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

New bi-directional flows 🔃

We're excited to announce a new way to set up your flows. Instead of connecting to "sources" or "targets," your users can now connect to any available "connector" in the dashboard and run jobs both ways for that tenant.

Screen Shot 2023-03-06 at 8.57.41 AM.png

Bi-directional flows are enabled by default for new users. Let us know if you're already using hotglue and want to try out these new flows.

Subtenants in the widget 🤝

Also released this past month, you can now create multiple connections to the same connector using "subtenants." This can be used for customers with multiple shops, or parent companies with multiple business entities.

Screen Shot 2023-03-07 at 10.59.52 PM.png

You can turn on subtenants in the widget settings.

New integrations ⚙️

image.png

In February, our integrations team added new taps for Salesloft and Salesforce Commerce. Additionally, we added new targets for Clickup, Jira, Google Cloud SQL (Postgres), Blackbaud, and QLS.

We also released support for new triggers for Salesforce and Quickbooks

We also released improvements to the following connectors:

Taps: Sage 50 UK, Amazon Seller, Outreach, Montapacking, Salesforce Sandbox, Shopify, Zoho Books, Woocommerce, BigCommerce, Hubspot, BigCommerce

Targets: Xero, Quickbooks Desktop, Quickbooks Online, netoHQ, Snowflake

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

  • A new "All Jobs" table to review and filter recent jobs across all tenants
  • Parquet output file type to preserve primary keys and typing
  • Support for mapping CSVs inside the widget
  • Added a promise when the widget is mounted
  • Configure automatic initial syncs on a flow level
  • Improved UI for creating default tenant jobs
  • Resolved stalled jobs bug
  • Expanded support for unified schemas
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • Extended tenant management and monitoring tools
  • Revamped targets with granular logging, straightforward documentation, and expanded support for updating records
  • Job monitoring with Slack and Heap

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: February 2023

Feb 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

New tenant drawer 👥

With the new tenant drawer, you can now access metadata, schedules, job history, snapshots, and more straight from the dashboard. This gives you fine-grained visibility into tenant configurations without having to touch the API.

Screen Shot 2023-02-20 at 6.02.36 PM.png

We will use this in the future to offer detailed filters, sorting, and analytics on your catalog of tenants. Let us know what sort of metadata you'd like to filter and sort your tenants with!

New integrations ⚙️

image.png

In January, our integrations team added new taps for QLS, GoHighLevel, and Shiphero. Additionally, we added new targets for Gong, Pipedrive, Wix, and Quickbooks Desktop.

We also released support for new triggers for Pipedrive, Salesforce, and GoHighLevel.

We also released improvements to the following connectors:

Taps: Hubspot, Dynamics, Netsuite, Chargebee, Wix, Stripe, Google Sheets, Amazon Seller, Quickbooks, Dynamics, and plentymarkets

Targets: Mailchimp and Moosend

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

  • Improved field map selection UI
  • Added support for receiving webhooks from your system
  • Added more granular details in job webhooks
  • Faster field map refreshes
  • Re-built static IP feature for improved performance and stability
  • Optimized performance for deleting and modifying objects
  • Improved job failure emails
  • Improved hotglue widget whitelabeling
  • Expanded support for unified schemas and real-time triggers
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • Bi-directional flows, allowing you to read and write data to the same connectors in a single flow
  • Native sub-tenant support in the widget
  • A new global jobs table to manage and filter jobs across tenants

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: January 2023

Jan 1st 2023

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Connector Roadmap 🛣

Have a new integration you need for your product? Instead of building it yourself, you can use our connector roadmap to request it. We'll add it to our roadmap, and once it's built we'll reach out to you.

Screen Shot 2023-02-18 at 6.02.14 PM.png

If the connector is already on our roadmap, you can use this page to upvote it and get it built faster!

New integrations ⚙️

image.png

In December, our integrations team added new taps for Google Analytics UA, Capsule CRM, Keap, FollowUpBoss, PowerBI, Montapacking, Fortnox, and Kustomer. Additionally, we added new targets for Quickbooks Sandbox, Odoo, and Montapacking.

We also released support for triggers for Shopify, CapsuleCRM, Keap, FollowUpBoss, Zendesk, and Pipedrive.

We also released improvements to the following connectors:

Taps: Intacct, Asana, Hubspot, Woocommerce, Xero, Chargebee, Amazon Seller, Plentymarkets

Targets: Shopify, NetSuite, Woocommerce

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

  • A toggle to avoid syncing historical data on the first sync
  • Ability to set the start date for linked sources via API
  • Ability to configure custom callback URIs
  • Optionally remove state from webhooks to keep data clean
  • Configurable increased job memory for individual tenants
  • Expanded support for unified schemas and real-time triggers
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • New access to tenant metadata--including configs, schedules, and custom metadata--directly from the dashboard
  • Enhanced widget whitelabelling and customization
  • Expanded support for unified schemas and real-time triggers

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: December 2022

Dec 1st 2022

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Fresh Unified Schema Docs 👨‍💻

The docs for unified schemas have a new home! You can now comb through the standardized data models for our most popular CRM, Accounting, and E-Commerce integrations.

Each table has a single schema, which you can use with the jobs endpoint to send data to any supported target via the hotglue unified API.

Screen Shot 2023-02-17 at 2.54.44 AM.png

We are continuously expanding the connectors that support unified schemas – let us know what connectors you want to see on this page!

New integrations ⚙️

image.png

In November, our integrations team added new taps for Zoho Books, Clockify, MYOB, Quickbooks Desktop, and Close.io. Additionally, we added new targets for Magento, Bexio, Mailerlite, Zoho Books, and Microsoft SQL.

We also released support for triggers for Zoho CRM, Mailchimp, ActiveCampaign, and Close.io

We also released improvements to the following connectors:

Taps: Intacct, Hubspot, Amazon Seller, Shopify, Google Analytics, Open Exchange Rates, Quickbooks, Woocommerce, Google Cloud Storage, Chargebee, Salesforce, and ActiveCampaign

Targets: WooCommerce, BigQuery, and MySQL

See the full list →

New features and improvements 🔨

Outside of our new connectors, the team made several improvements including:

  • Multiple upgrades to the widget, including improved field mapping, validation, and catalogs
  • Ability to promote individual sources and targets across environments for more granular version control
  • Filtering by date and time on the jobs dashboard
  • Previews of the next scheduled job in the dashboard
  • Faster performance for refreshing catalogs
  • Option to trigger discovers automatically inside the widget
  • Faster performance of hotglue GET endpoints
  • Expanded support for unified schemas and real-time triggers
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • A public integrations roadmap for you to track our progress and request new connectors
  • More robust snapshotting and faster job performance
  • Expanded support for unified schemas and real-time triggers

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: November 2022

Nov 1st 2022

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Unified Schemas 📖

We have added the ability to enable and use our Unified Schemas for CRM, Accounting, and E-Commerce integrations directly inside the hotglue admin panel.

Simply enable the Unified Schema toggle in your source settings, and choose the relevant tables. All data will come through in our unified schema rather than the raw source schema.

Screen Shot 2023-02-10 at 3.57.20 PM.png

We are working on expanding the connectors that support unified schemas and what tables we support – let us know if you are interested in using this feature!

New integrations ⚙️

image (27).png

In November, our integrations team added new taps for Copper, AgileCRM, Sellsy, PlentyMarkets. Additionally, we added a new unified schema target for Zoho.

We also released support for triggers for QuickBooks, Shopify, and WooCommerce

We also released improvements to the following connectors:

Taps: Salesforce, QuickBooks, Chargebee, HubSpot, Amazon Seller, CIN7, Google Analytics, SFTP

Targets: BigQuery, Snowflake, WooCommerce

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • Shipped support for OAuth 1 connectors such as Magento 1
  • Added option to automatically trigger a sync when a new integration is linked
  • Added option to set hourly sync schedules in admin UI
  • Added option to manually link a tenant in the admin dashboard
  • Improved error handling and validation on API calls
  • Improved stability of job rollbacks
  • Added automatic detection of jobs that failed due to invalid credentials
  • Allow overriding widget options for specific flows
  • Added ability for users to request new connectors
  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • Improved performance for refreshing catalogs for sources
  • Expanded support for unified schemas and real-time triggers
  • Ability to connect multiple accounts from the same integration (for example, allow tenants to connect multiple Shopify stores in the widget)
  • A new home for the unified schemas documentation and examples

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: October 2022

Oct 17th 2022

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Real-time Job Triggers ⚡

We have officially launched support for real-time triggers for several integrations, including: Salesforce, HubSpot, and Shopify. Triggers allow you to automatically run sync jobs when something happens in a source system. For example, as soon as a new contact is created in HubSpot or Salesforce, hotglue will receive a webhook on your behalf, and trigger a job.

hotglue salesforce triggers

We are rapidly expanding support based on demand – let us know if there are any you are interested in!

Mapping in the Widget 🔌

We have added support for allowing tenants to do simple mappings of their data in the widget. This works for both source flows, where you want tenants to map to your own data schema (for example, a tenant could map a custom Salesforce object to your Contact schema), and for target flows, where you want tenants to map their data in your product to a target.

To learn more or try this beta feature, reach out to us at hello@hotglue.xyz. Public documentation is coming soon!

hotglue widget mapping

Detailed Job Metrics 📊

While sync jobs run, hotglue will automatically track the number of records collected for every stream in real time. This allows you to have more visibility into a particular sync and its progress! This data is also made available via the API. See a sample below:

sync job metrics

New integrations ⚙️

hgmelt-october-2022-new-integrations.png

In September, our integrations team added new taps for FTP, MooSend, PostHog, MySQL, Jotform, and Sellsy. Additionally, we added new unified schema targets for MooSend, WooCommerce, ActiveCampaign, Sage Intacct, and Dynamics 365 Business Central.

We also released improvements to the following connectors:

Taps: HubSpot, NetSuite, Dynamics 365 Business Central, QuickBooks

Targets: BigQuery, NetSuite

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • Updated job metric graphs in environment dashboard. New graphs show failing jobs, record counts, and more!

  • Added new setup guide for new users, which includes videos and guides explaining hotglue concepts. You can always launch the setup guide via the Environment Settings.

  • Launched new landing pages describing our unified schema features!

    • Also updated footer to include more categories from our integrations library
  • Added ability to Clone Flows to other environments

  • Added ability to store a "snapshot" of reference data required for targets to optimize their runtime. Currently available for target NetSuite, and will be coming to other targets soon!

  • Updated notification emails for improved look & feel

    • Job failure alerts will now include summary error messages to provide more information
  • Added option to allow tenants to trigger full sync jobs in the widget

  • Updated JupyterLab connections to use SSL

  • Made source catalog available during ETL runtime

  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • Option to use Unified Schemas directly inside hotglue
  • Ability to connect multiple accounts from the same integration (for example, allow tenants to connect multiple Shopify stores in the widget)
  • Support for OAuth 1 integrations

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: September 2022

Sep 1st 2022

Hi hotgluers!

Welcome to our monthly hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

New Scheduler Service 🗓️

We have updated our scheduler for triggering jobs to handle the higher volume of scheduled jobs we are seeing.

Note: As a part of this change, we have moved away from AWS EventBridge cron expressions to standard UNIX cron expressions. You will receive email alerts if any of the cron expressions you are using cannot be automatically converted to the new format.

New integrations ⚙️

hgmelt-september-2022-new-integrations.png

In August, our integrations team added new taps for Sage 50 UK, Dynamics 365 Finance & Operations, Mailstep, and Notion. Additionally, we added new unified schema targets for Dynamics 365 Sales and Shopify.

We also released improvements to the following connectors:

Taps: HubSpot, Google Analytics, WooCommerce, Magento, Chargebee, QuickBooks, and Prestashop

Targets: Salesforce, NetSuite

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • Updated billing functionality

    • You can now view your active tenant usage and manage your hotglue subscription from directly within your Account Settings!
    • Automatic warning alerts will be emailed to your hotglue org members as you reach active tenant limits
  • Download Job service has been updated to allow you to download cached data from larger jobs (up to 20GB)

  • hotglue widget updates

    • Added support for localization
    • Added new option to hide back buttons when using HotGlue.link function
    • Added flag to allow tenants to link multiple sources in a single flow
    • Fixed bugs in scheduling UI
  • Added ability to retrigger failed jobs without rerunning the SYNC phase. This is mainly used for testing/updating ETL scripts.

  • The UI for refreshing field maps for taps has been updated:

    • While refreshing, the field map will be inaccessible and show that it is being refreshed in the backend
    • Added visibility into logs of the refresh field map process (we call this a discover) in case of issues
  • General bug fixes and stability improvements

    • We suffered a major AWS outage in our region (us-east-1), but were able to avoid an extended outage by switching to the us-west-1 region. To stay updated on outages like this, subscribe to our status page updates.

Next up 📈

Here are some things to look forward to in the next updates:

  • Mapping in the widget
  • Real-time triggers for sync jobs
  • Job Metrics for both past & running jobs

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: July 2022

Aug 1st 2022

Hi hotgluers!

Welcome to our sixth hotglue melt - we have got some awesome updates to share!

Product Updates 🚀

Updated Landing Pages 🎨

We have updated our landing pages to more closely match our brand and explain the possible use-cases for hotglue. This includes an interactive preview of the new hotglue widget, more emphasis on the developer experience, updated graphics, and more. See a preview below:

hotglue.com_.png

Updated integrations ⚙️

image (12).png

In July, our integrations team focused on expanding our unified schemas and library of targets (integrations that push data to other platforms). Notably we have released new versions of targets that use the unified schemas: Salesforce, HubSpot, Xero, and NetSuite.

Additionally, we have released new Magento v1, Wix, GitHub, and Stripe taps that feature better performance and data models. We also released improvements to the Facebook Ads, Amazon Seller, Prestashop, Chargebee, HubSpot, Magento, and Zendesk taps.

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • Added support for the gluestick to_singer function to enhance support for typing and setting primary keys when pushing data to targets

  • Added support for using both etl.py and etl.ipynb formats for ETL scripts

  • @hotglue/widget package updates

    • Added a hideFlows option to hide flow containers in the Connections component
    • Added class names to customize styling on the Connections component
    • Updated text under Quick Actions section in widget
    • Fixed compatibility issues with NextJS
    • Fixed bugs with unlinking connected integrations
  • Added command to delete deployed ETL scripts to hotglue CLI

  • Fixed timeout issues when downloading long job logs

  • Added optional upsert option to toggle sync schedule endpoint to apply default schedule to all tenants

  • General bug fixes and stability improvements

    • Fixed issue with flow icons being expired/disappearing
    • Added error message to explain when OAuth window pop-up is blocked
    • Improved error message detection logic in jobs

Next up 📈

Here are some things to look forward to in the next updates:

  • Mapping in the widget
  • Real-time triggers for sync jobs
  • Job Metrics for both past & running jobs

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: June 2022

Jul 1st 2022

Hi hotgluers!

Welcome to our fifth hotglue melt - we have got some awesome updates to share!

Our Team 🤝

In June we welcomed Davi, an awesome full stack engineer, to our team! We are super pumped to have him join us and help the product reach the next level.

Product Updates 🚀

React component + npm package 🎨

We have released the new hotglue widget as an npm package to make the setup process more streamlined. Part of this change includes a totally overhauled Connections React component, an inline version of the hotglue widget. The goal of the Connections component is to allow for a more native user experience for tenants. See an example below:

d7ce86d-qa.hotglue.xyz_env_demo.env.hotglue.xyz_content_home.png

You can learn more about the widget, React component, and the new installation process in the docs: https://docs.hotglue.com/docs/embed-hotglue

Note: The old Connections component was previously available in the now deprecated hotglue-elements package.

Revamped Google Sheets integration 🤩

qa.hotglue.xyz_env_dummy.hotglue.hotglue.io_content_home.png

As mentioned in our last update, one of our goals this month was to revamp the Google Sheets integration. We have vastly simplified the user experience for tenants that are connecting their Google Sheets. Beyond that, the new version of the integration also reduces the amount of setup required.

The new Google Sheets integration is already available for use, and we would love any feedback or suggestions you have! Feel free to reach out at hello@hotglue.xyz

New integrations ⚙️

image (4).png

As usual, our integrations team added more integrations – notable ones include Google Workspace, Fishbowl Inventory, Gong, Delighted, Google Play Store, Front, Metronome, and iTunes Connect. We also released improvements to the HubSpot, WooCommerce, Salesforce, Iterable, Chargebee, Snowflake, and more.

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • Resolved issues with downloading large jobs directly from the hotglue admin panel!

  • Improvements to job logging:

    • Cleaned up the logging of exceptions in failing jobs to make them more readable
    • Added a section in admin panel to see a summarized log of why a job failed
    • Added an error field to the job details returned from the API including the summary log of why the job failed
  • Added the option to enable a Job History tab in the widget, so tenants have visibility into the sync jobs that have run. See below:

    qa.hotglue.xyz_env_dev.xyz.com_content_settings_tab=widget.png

  • Added PATCH endpoint to allow updating the tenant config. Read more in the docs

  • Added revoke parameter to DELETE tenant endpoint which deauthorizes any active OAuth connections before deleting the tenant. Read more in the docs

  • You can now choose a color to easily identify your hotglue environments in the admin panel, and update their names.

  • Enabled ability to override the default scopes for the HubSpot connectors in the admin panel

  • General bug fixes and stability improvements

Next up 📈

Here are some things to look forward to in the next updates:

  • Unified schemas
  • Mapping in the widget
  • Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: May 2022

Jun 1st 2022

Hi hotgluers!

Welcome to our fourth hotglue melt - we have got some awesome updates to share!

Our Team 🤝

hotglue team meetup - Sao Paulo Brazil

As some of you may know, the hotglue team is fully remote with members from the United States, Brazil, Pakistan, and the Philippines. We recently had our first company meetup in São Paulo, Brazil – home to our amazing frontend engineer, Breno!

We wanted to share our first team picture (with everyone wearing their new hotglue swag 😎) from the trip with all of you. None of this would be possible without your support, and we are excited to continue our mission to make building native integrations simpler.

Product Updates 🚀

Redesigned Widget 🤩

hotglue widget v2 preview

As mentioned in our last update, our product team has been hard at work on a new version of the hotglue widget. Our goals were to radically enhance the UI to give a more intuitive experience for users and deliver a polished interface. Beyond that, we are focusing on increasing the customizability of the widget so you have more control over your users integration experience.

The new widget is already available for use! You can learn how to upgrade on our docs.

We would love any feedback and suggestions you have! Feel free to reach out at at hello@hotglue.xyz

New integrations ⚙️

hotglue - May new integrations

As usual, our integrations team added more integrations – notable ones include SKUVault, SFTP Files, and Zendesk. We also released improvements to the Amazon Seller, Chargebee, Magento, Unleashed, Bexio, Pipedrive, HubSpot Beta, and Fulfil integrations.

Note: We are advising all users of our HubSpot integration to upgrade to our new connector (labeled HubSpot (B) in the hotglue UI). The new connector features performance improvements and a data model that is much easier to work with. If you have any questions, please reach out to us!

See the full list →

New features and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • hotglue now integrates with Datadog! You can configure hotglue to push job events (success or failures) directly to your Datadog events to maintain observability in one platform. Learn more in the docs.

  • We have developed an improved SFTP integration (called SFTP Files), allows users to browse their SFTP server and select the files/directories they want to clone! See a preview below:

    Screen Shot 2022-06-09 at 11.35.04 AM.png

  • You can now use your own S3 buckets to cache job data and snapshots! If you're interested in trying this feature, contact us to help you get it setup :)

Next up 📈

Here are some things to look forward to in the next updates:

  • Improvements to our embeddable UI

    • Ability to install widget via npm
    • Updated React component with better performance and customizability
  • Improved Google Sheets integration

  • Unified schemas

  • Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: April 2022

May 1st 2022

Hi hotgluers!

Welcome to our third hotglue melt - we have got some awesome updates for you all.

Product 🚀

Redesigned UI 🤩

dashboard.png

Our product team is extremely excited to launch a redesign of the hotglue admin panel! The goal of the redesign was to create a more polished UI with a more intuitive UX. We would love feedback from users as they try it out!

New integrations ⚙️

April new integrations

In April, our integrations team added a whopping 27 new integrations! The most notable are:

  • RingCentral
  • Freshcaller
  • Snowflake
  • Outreach
  • Zuora
  • Amplitude
  • Intercom
  • BigCommerce
  • Shipbob
  • Fulfil.io
  • Ordoro
  • Ecwid
  • Exact Online
  • NetoHQ
  • Vilkas
  • Wannafind
  • Dear Systems
  • Abicart

See the full list →

Bug fixes and improvements 🔨

Outside of our awesome redesign, the team made several improvements including:

  • Overall API performance improvements
  • Added endpoint and option in admin panel to force kill jobs. See the docs.
  • Added option to save snapshots even if jobs fail
  • Improved job queue times (now they start faster!)

Next up 📈

Here are some things to look forward to in the next updates:

  • hotglue widget v2
  • Unified schemas
  • Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


hotglue melt: March 2022

Apr 25th 2022

Hi hotgluers!

Welcome to our second hotglue melt - we have got some awesome updates for you all.

Security 🔒

In March, we received our official SOC 2 Type II certification! Data security and privacy is an essential component of our dedication to upholding our promise to protect sensitive user data. As we continue to grow as a company, our commitment to security remains steadfast.

Read more →

Product 🚀

New integrations ⚙️

s19o.png

Last month, we added 7 new integrations! The most notable are our new Bexio, Amazon Seller, and Freshsales integrations. We've also released updates for our NetSuite, Chargebee, Zoho, and Prestashop integrations, among others.

Read more →

New features and improvements 🔨

The product team did some amazing work during March. Here is what they did:

  • Created new daily tenant report to see failing jobs by tenant (you can enable in your settings)
  • Added option to enable error notifications for all failing jobs (used to just be for scheduled jobs)
  • Added option to automatically rollback failed jobs
  • Jupyter workspace will now notify you when it becomes inactive (instead of a silent shutdown)

Next up 📈

Here are some things to look forward to in the next updates:

  • A brand new look for hotglue 👀
  • Unified schemas
  • Audit trail for sub-users

If you have anything you would like hotglue to focus on in the near future, you can send us suggestions at hello@hotglue.xyz.

See you next month! 👋


🛠️ Fix
👍 Improvement
🔥 Feature
💡 Integration

February Update - new integrations, CLI, and more!

Mar 1st 2022

Hey hotgluers! Here are the updates:

59fdf0af1b73054ffca6e6c510f85c26

We have a lot of new fantastic features and improvements that we rolled out this month. Here they are:

  • The first edition of the hotglue CLI
  • Improved speed and stability of registration flow
  • Added a personal API key on an account level
  • Added support for creating symlinks across tenants
  • Added allowing tenants to change field map in the widget
  • Added support for larger job history list
  • Updated our integrations pages
  • Improved stability of provisioning jobs (less stalled jobs)
  • Added the ability to filter flows shown in hotglue-elements React component
  • Added an endpoint to apply a new sync schedule for all tenants using a flow

We also have 22 new integrations 🎉

  • Travefy tap
  • Travefy target
  • Auth0 tap
  • Cognito tap
  • Cin7 tap
  • Microsoft Dynamics 365 Business Central tap
  • Firebase Auth tap
  • Firestore tap
  • Firestore target
  • Gambio tap
  • Linear tap
  • Magento tap
  • MongoDB tap
  • MongoDB target
  • Ongoing WMS tap
  • Postgres tap
  • SAP S/4HANA Cloud tap
  • SFTP Files tap
  • Shoplazza tap
  • Shoptet tap
  • Zoho CRM tap
  • Zoom tap

Integration updates and bug fixes

  • tap-stripe - added support payment intents
  • tap-netsuite - fixed a bug with the incremental syncing
  • tap-prestashop - fixed a bug with the schema
  • tap-reviewsio - fixed a bug with the schemas
  • tap-shop - updated handling for rate limits
  • target-bigquery - added support for incremental updates
  • target-postgres - added support for setting a primary key
  • tap-salesforce - enabled for sandbox accounts
  • tap-mixpanel - fixed a bug regarding ignoring malformed records from their api

Stay tuned for more updates next time 🍻


🛠️ Fix
🔥 Feature
💡 Integration

Multi-factor Auth, Facebook Ads, and more!

Jan 14th 2022

Happy Friday hotgluers! Here are the updates:

c3566b67c52061290a8b3e3a31fa2a72

  • You can now secure your account by enabling Multi-Factor Authentication in your Account Settings 🚀

  • Added filter to query exclusively for scheduled jobs

  • HubSpot target now supports calling discover to get available objects/fields (similar to sources)

  • New endpoint for creating/updating a tenant config, which is available during runtime of transformation scripts

  • Bug fixes

    • Bootstrap error in browser console resolved
    • Prevent invalid widget preferences from being saved
    • GET /tenants endpoint timeout issue resolved and performance improved
    • Updated widget to call onTargetLinked correctly – was causing issues in hotglue-elements
  • New integrations have arrived 🎉

    • tap-facebook – currently supports pulling data from Facebook Ads
    • tap-amazon-advertising
    • tap-mailgun
    • tap-appsflyer
  • Integration updates and bug fixes

    • tap-cloud-storagebug fixed regarding local clone path
    • tap-omnisendschema issues resolved
    • tap-klaviyonow supports API key validation
    • tap-iterablenow uses correct start_date formatting for querying users data
    • tap-chargebeenow supports pulling exchange_rate from credit notes
    • target-netsuite now supports including customer in journal entries
    • target-shopify now supports incrementing inventory_level
    • target-hubspot now supports pushing contacts data

Stay tuned for more updates next time 🍻


🛠️ Fix
🔥 Feature
💡 Integration

Bug fixes, JIRA source, and HubSpot + SFTP targets

Dec 31st 2021

Happy Friday and Happy New Year hotgluers! Here are the updates:

  • You can now modify your notification preferences! Toggle updates on environment creation and scheduled job failures under Account Settings 🚀

  • Added count query param to get jobs endpoint to allow retrieving full job history

  • Bug fixes

    • Issues when adding/editing supported targets in hotglue panel fixed
    • Prevent invalid state.json files from being used by future jobs (discovered with tap-klaviyo)
  • New integrations have arrived

    • target-hubspot – currently supports pushing engagements and contacts to HubSpot
    • target-sftp
    • tap-jira
  • Integration updates and bug fixes

    • tap-netsuite

      bug fixes:

      • Item rate schema fixed
      • handle malformed search results (ignore malformed pages)
      • empty data error resolved
    • tap-sftpnow supports delete_after_sync option which automatically purges files from remote server after sync is completed

    • tap-shopifynow supports pulling shop data and orders in transit

    • target-netsuite

      updates:

      • bug with retry warning causing errors in job fixed
      • support for manually passing subsidiary field
      • remove case sensitivity for posting type
    • target-intacctissues with case sensitive posting type and rounding errors fixed

    • target-shopifynow supports updating inventory_level

Stay tuned for more updates next time 🍻


Introducing team members! 🚀

Dec 17th 2021

Happy Friday hotgluers! Here are the updates:

122f6e70a9cb52f51c7b59311f3a68cc

  • You can now invite your team members to join your hotglue organization! Find this option under Account Settings 🚀

  • Secret API Key is now available under your environment settings. Note: any requests from your backend should now be done using the secret API key, not the public API key.

  • Bug fixes

    • Stalled jobs (stuck in JOB_CREATED) are automatically handled
    • Toggle sync schedule endpoint timeout issue fixed
    • Failing scheduled job alert has been re-enabled
  • New integrations have arrived

    • tap-recurly
    • tap-omnisend
  • Integration updates and bug fixes

    • tap-googleadshas been updated to support campaign_budget and invoices
    • tap-sftphas been updated to parallelize processing of files and fixed hitting TooManyFilesError
    • tap-dynamicshas been updated to allow deselecting fields and use org parameter rather than full domain
    • tap-salesforcenow avoids holding ListView data in memory during execution
    • target-salesforce now supports pushing any objects (including custom data), and allows for updating objects using an external ID
    • target-quickbooks now supports pushing invoices
    • target-queue-storage bug fixed causing issues with processing payloads with less than 512 entries
    • tap-procore now supports pulling Purchase Orders
    • tap-netsuitenow supports pulling Purchase Orders
    • target-xero now supports pushing Journal Entries with configurable department and location fields
    • target-netsuite now supports pushing Journal Entries with department and location fields
    • target-shopify now supports posting updates to inventory_level

Stay tuned for more updates next time 🍻


🛠️ Fix
👍 Improvement
💡 Integration

Sendinblue, Reviews.io, Iterable, and more!

Dec 3rd 2021

Happy Friday hotgluers! Here are the updates:

  • Added ability to run multiple target jobs for one user concurrently! 🚀

  • New integrations have arrived

    • tap-sendinblue allows you to pull lists, list members, and campaigns from Sendinblue!
    • tap-iterable
    • tap-blob-storage
    • tap-reviewsio allows you to pull merchant and product reviews from Reviews.io!
    • target-salesforcenow allows you to push tasks directly to Salesforce!
    • target-woocommercenow allows you to push products directly to WooCommerce!
  • Integration updates and bug fixes

    • target-queue-storagehas been updated to use multi-threading to handle larger payloads in less time 🎉
    • target-s3now supports using SSE and allows users to set an ACL option
    • tap-googleadshas been updated to use the new Google Ads API (instead of the older Adwords API, which has been deprecated by Google)
    • tap-netsuitehas been updated to include internalId in payloads
    • tap-sftphas been updated to automatically detect encoding to support non UTF-8 encoded CSV files
    • tap-mixpanelhas been updated with new error handling to catch unexpected responses from Mixpanel's API

Stay tuned for more updates next time 🍻


🛠️ Fix
🔥 Feature
💡 Integration

Widget updates, new integrations, and bug fixes!

Nov 19th 2021

Happy Friday hotgluers! Here are the updates:

  • Added automatic validation of tokens for API-based sources in the widget. Beta support is now available for Mailshake and ActiveCampaign 🚀

  • New version of hotglue-elements (0.0.15) with support for target flows

  • Added new widget options:

    • setting to disable breadcrumbs in widget
    • ability to specify helper text in markdown when using HotGlue.link
  • Updated the demo on our landing page!

  • New integrations have arrived

    • tap-clickup
    • tap-klaviyo
    • tap-dynamics
    • target-google-sheets
    • target-netsuite
  • Integration updates and bug fixes

    • target-queue-storagenow supports parallelization even with smaller payloads to improve performance, and the log level has been fixed to avoid debug spam in job logs 🎉
    • target-ispoliticalhas been updated to support pushing payouts and refunds, and ISO 8601 date formats in payloads
    • tap-mixpanelhas had several bug fixes to improve sync speeds and handle edge cases with malformed cohort members
    • tap-klaviyopatch****to avoid throwing an error during discover step
    • tap-netsuitehas been updated to support pulling inventory management data (SalesOrders, InventoryItems, PriceLevel, and more!)
    • target-intaccthas been updated to support pushing department and location data with journal entries
    • target-shopifynow supports pushing product variants and inventory quantities
  • Added new listeners to the widget

    • onTargetUnlinked
    • onWidgetOpen

Stay tuned for more updates next time 🍻


🛠️ Fix
👍 Improvement
🔥 Feature
💡 Integration

Job Logs Revamp, Shopify target, and bug fixes

Nov 5th 2021

Happy Friday hotgluers! Here are the updates:

995e4b3f52ae2c5b6eed5c7eab995d50

  • Revamped job logs view, designed to handle longer job logs 🎉

    • Added search functionality to job logs
    • Added ability to read job logs chronologically or reverse chronologically
  • Added setting to automatically enable default sync schedule when tenants link a source

  • Fixed bug with OAuth target settings not working

  • Added support for tap Statflo – currently supports pulling Customer Activity

  • Added support for target Shopify – currently supports pushing products

  • Updated tap-intacct to dynamically pull and use available fields

  • Fixed bug in tap-mixpanel causing errors when pulling cohort_members

  • Fixed bug in tap-blackbaud causing errors due to a dependency mismatch

Stay tuned for more updates next time 🍻


👍 Improvement
💡 Integration

Shopify OAuth, ISPolitical, and expanded coverage

Oct 22nd 2021

Happy Friday hotgluers! Here are the updates:

  • Updated our docs and API reference 🎉
  • Updated sidebar to include direct links to book a support call and access the docs
  • Added support for using Shopify OAuth apps instead of only allowing API keys
  • Added support for target ISPolitical
  • Added new endpoints to manage state.json of sources via API
  • Updated UI for using testing tokens with OAuth apps
  • Expanded coverage of tap-intacct to include ARINVOICE, ARADJUSTMENT, CUSTOMER, and ITEM
  • Expanded coverage of tap-blackbaud to include education, lifetime giving, and fundraiser assignment

Stay tuned for more updates next time 🍻


🛠️ Fix
👍 Improvement
💡 Integration

Mixpanel, SFTP, and MySQL support + bug fixes

Oct 1st 2021

Happy Friday hotgluers! Here are the updates:

91daf24a839a4299f0a19b51bf52aadc

  • Added support for tap Mixpaneland SFTP 🎉 – docs coming soon 📖

  • Added support for targetMySQL

  • Restructured the Flow details page to be more intuitive

  • Improved tenant search functionality

  • Enabled passing state data directly from hotglue API to a job

  • Fixed issue with clearing webhook settings in environment settings page

  • Fixed bugs with modifying sync schedules in job sync schedule page

  • Fixed error when starting multiple Jupyter workspaces for the same flow

  • hotglue-elements

    version

    0.0.14

    released 🚀

    • Improved load time on first open of Connections component

Stay tuned for more updates next time 🍻


🛠️ Fix
🔥 Feature
💡 Integration

Revamped sidebar, new taps + bug fixes

Sep 15th 2021

Happy Wednesday hotgluers! Here are this week's updates:

  • https://img.announcekit.app/ae0ff021d7b40c9ef46135c107ab756a?s=8f4fa638275caa085065f0da8d6c8f0fImproved sidebar with better navigation + performance (plus, it looks better 👀)
  • Added support for tap Airtable, WooCommerce,****and Blackbaud 🎉
  • Fixed issues with saving field map for tenants
  • Fixed bug in target-csv causing issues with validating floats
  • Added support for OAuth sources that also need user configured params
  • Added endpoint to toggle schedules for all tenants in a given environment
  • Removed table name requirement for Airtable target
  • Fixed errors causing schedule endpoint to fail
  • Bumped target Quickbooks version
  • Fixed bugs where Source page would overflow on smaller browser sizes
  • Bumped tap Chargebee version to support pulling currency_code
  • Switched to use the Data Mill Singer PostgreSQL target to handle creation of tables + columns automatically

Stay tuned for more updates next week 🍻


🛠️ Fix
💡 Integration

Mailchimp & PagerDuty support + bug fixes

Aug 6th 2021

Happy Friday hotgluers! Here are this week's updates:

  • Added support for tap Mailchimp and PagerDuty 🎉 – docs coming soon 📖

  • Fixed issues when loading JupyterLab workspace from hotglue panel

  • hotglue widget now validates that required fields for API sources are filled (such as tap NetSuite and Chargebe)

  • Fixed bug on target Intacct that caused issues when a Currency was passed to a Journal entry

  • Fixed bug that allowed users to open errored environments

  • Updated field map interface to use the catalog for the selected tenant

  • hotglue-elements

    version

    0.0.13

    released 🚀

    • Fixed bug where clicking linked source would cause infinite loading until page refresh
    • Added ability to supply styleOverrides directly to the Connections component

Stay tuned for more updates next week 🍻


💡 Integration
🔥 Feature
💡 Integration

Recipes, UX updates, new sources, and more! 🚀

Jul 28th 2021

Hey hotgluers! We've been super busy over the last few weeks, and we're excited to share our updates!

Recipes 👩‍🍳

Many users have benefited from having a starting point when creating a new integration. To that end, we're excited to announce a brand new recipes feature!

When you head into the settings page for certain sources, you'll find a new recipes section which allows you to use one of our prebuilt configurations. Currently, recipes include pulling contacts and contact lists from CRMs like Salesforce, and pulling tickets/issues from systems like Asana and GitHub.

You can check out a short demo of this feature below!

Outside of that, here are all the updates:

  • HackerNews launch with open sign up

  • Recipes for CRMs (Salesforce, HubSpot) and Issue Systems (GitHub, GitLab), with more coming! 👩‍🍳

  • Major UX overhaul including:

    • Updated field map interface with performance improvements and emphasis on search

      • Catalog of available objects from each source, now allows you to browse the entire selection directly from hotglue!
      • Field editor on each object is now searchable and easier to navigate
    • Sources page is now segmented into specific categories, and has many performance improvements

  • Added support for tap GitHub and ActiveCampaign 🎉 – with many more integrations on the way

  • Bug fixes on target Xero

  • Updated onboarding process for new users

Stay tuned for more updates next week! 🍻


🛠️ Fix
👍 Improvement
💡 Integration

Airtable, Google Sheets support + misc bug fixes

Jul 9th 2021

Happy Friday hotgluers! Here are this week's updates:

  • Added support for target Airtable 🎉 – you can now push data directly to an Airtable base/table. Check out the open source Singer target on GitHub

  • Added support for tap Google Sheets – you can now sync data from a Google Sheet! Docs coming soon 📖

  • Added support for variables in the dataset IDfor target BigQuery – similar to path prefixes in target S3/Cloud Storage/Blob Storage (ex. {tenant_id}, {flow_id})

  • hotglue-elements

    version

    0.0.11

    released 🚀

    • When user clicks source, a loading icon is shown to let them know the hotglue widget is loading (load time improvements are in the works)
    • Allow styling the loading container
    • Added listeners for onPopupClose and onWidgetClose
  • Fixed bug where failing to link a testing OAuth source in the admin panel showed the error as [Object] object instead of displaying the real error

  • Fixed wrong API error code being sent (500 instead of 400) on BadRequest

Stay tuned for more updates next week 🍻


🛠️ Fix
👍 Improvement
💡 Integration

BigQuery support, bug fixes, and improvements

Jul 2nd 2021

Happy Friday hotgluers! 🚀

This week we've got a few updates to share:

  • Added support for tap BigQuery and target BigQuery 🎉
  • Procore tap now supports syncing from the root project directory
  • Added trial counter for new users so they can upgrade from within hotglue
  • Fixed bug where changing the OAuth tokens for a source reset the Python script being used
  • Fixed bug causing default environment to error on registration
  • Updated verification email formatting 🔥
  • Fixed bug with preload option in hotglue widget
  • Added ability to consume JWT token in widget to edit secret configs (ie. API keys for sources like Chargebee)

Stay tuned for more updates coming in the next few weeks! 🍻


🛠️ Fix
🔥 Feature

New taps + bug fixes

Jun 25th 2021

Happy Friday hotgluers!

I'd love to share some improvements made over the last week:

  • Support for secret API key that has permission to retrieve secret data (like client_secret configuration for a source)
  • Fixed issue with hotglue-elements on some browsers where the React element didn't wait for the hotglue widget to be present in the DOM before mounting
  • Fixed bug with JupyterLab workspaces allowing users to connect before they had booted
  • Fixed bug requiring users to refresh to see new sources in a flow in the new job dialog
  • Fixed bug with launching new jobs for tenants via the dialog
  • Fixed bug loading configured flow targets that showed the list of all targets first
  • Both tap NetSuite and tap Pipedrive are out of beta! 🎉
  • Added support for tap GitLab
  • Procore tap has been updated to include project_id metadata in each substream


👍 Improvement

General improvements

Jun 15th 2021

Happy Tuesday hotgluers!

We're making an effort to be more transparent with our users regarding changes to the product and how things are going at hotglue!

To that end, I'd love to share some improvements made over the last week:

  • The Sources page is now categorized into several types of sources: Accounting, Sales & CRM, Marketing, Billing, Analytics, and more 🎉
  • Switching to a tenant view now shows a hovering alert to be more apparent than updating the header (where environment name is shown)
  • Typed + required fields are now supported in the hotglue widget for API sources
  • Quickbooks, and Xero targets have been updated to automatically rollback failed Journal Entry postings
  • HubSpot tap updated to allow fetching companies_properties
  • Job download artifacts will now include Singer tap information, to enable local reproduction of issues (catalog.json, fieldMap.json)

Stay tuned for more updates soon! 🚀