Databricks Data Engineer – Sales Incentive Compensation | New York, NY

Databricks Data Engineer – Sales Incentive Compensation

📍 Location: New York, New York
🏢 Work Arrangement: Hybrid
📄 Contract Length: Six Months
💰 Hourly Rate: Approximately $75 per hour
💼 Employment Type: Contract
🚫 Visa Sponsorship: Not Available
🚚 Relocation Assistance: Not Available
🏦 Industry: Insurance and Financial Services

Build the Data Infrastructure Behind Enterprise Sales Compensation

A leading global organization is seeking an experienced Databricks Data Engineer to design, develop and optimize enterprise data solutions supporting analytics, performance reporting and Sales Incentive Compensation.

This is not purely a pipeline-development position. The successful candidate will combine strong Databricks engineering expertise with an understanding of incentive compensation processes, including quota allocation, attainment calculations, commission processing and payout reporting.

You will work closely with Sales Operations, Finance, Business Intelligence and technology teams to translate complex business rules into scalable, accurate and auditable data solutions.

Why This Opportunity Stands Out

This opportunity will allow you to:

• Own the design and development of enterprise Databricks solutions

• Influence the wider Databricks architecture and technical roadmap

• Build data pipelines supporting business-critical compensation processes

• Work with Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows

• Translate complex incentive-plan rules into reliable transformation logic

• Improve automation, integration, data quality and platform performance

• Partner directly with senior Finance, Sales Operations and technology stakeholders

• Deliver solutions that directly influence commission and compensation accuracy

What You’ll Be Doing

Databricks Architecture and Engineering

• Design, develop and implement scalable Databricks-based data solutions

• Build and maintain data pipelines supporting ingestion, transformation, reporting and analytics

• Develop data models, Delta Lake tables, notebooks and reporting datasets

• Take ownership of the overall Databricks architecture

• Ensure new pipelines and enhancements integrate effectively with existing workflows

• Maintain and optimize Databricks workspaces, pipelines and orchestration processes

• Identify opportunities to improve automation, performance and data integration

• Design reliable ETL and ELT processes across multiple enterprise data sources

Sales Incentive Compensation

• Build data pipelines supporting Sales Incentive Compensation processes

• Translate incentive-plan rules into accurate and auditable data transformations

• Support quota allocation and quota-management processes

• Develop logic for attainment tracking and performance calculations

• Support commission calculations and payout processing

• Produce reliable datasets for compensation reporting and reconciliation

• Work closely with Sales Operations and Finance to understand plan structures and business rules

• Ensure calculation logic is transparent, documented and capable of being audited

• Integrate incentive-compensation platforms with enterprise data and analytics solutions

Performance and Data Quality

• Test, debug and optimize Databricks pipelines and notebooks

• Investigate and resolve data-quality, performance and integration issues

• Improve the reliability and efficiency of existing workflows

• Implement appropriate controls and validation processes

• Monitor data pipelines and troubleshoot failures or inconsistencies

• Deliver a high-quality experience for analysts and other data consumers

Stakeholder and Technical Collaboration

• Work with business stakeholders to understand complex data requirements

• Translate functional requirements into scalable technical architectures

• Challenge requirements constructively when a more effective solution is available

• Partner with Finance, Sales Operations, IT and Business Intelligence teams

• Provide technical support to analysts and end users

• Communicate technical concepts clearly to both technical and non-technical audiences

• Manage multiple priorities within a fast-paced enterprise environment

Documentation and Platform Development

• Document data architectures, models, pipelines and configuration decisions

• Produce clear technical specifications and development documentation

• Maintain documentation to support knowledge transfer and long-term platform ownership

• Stay current with Databricks capabilities and platform enhancements

• Identify opportunities to use features such as Unity Catalog, Delta Live Tables and Photon

What You’ll Bring

Essential Databricks and Data Engineering Experience

• At least seven years of professional data-engineering experience

• A minimum of three years of hands-on Databricks experience

• Extensive experience building and managing production Databricks solutions

• Strong knowledge of:

• Delta Lake

• Delta Live Tables

• Unity Catalog

• Databricks Workflows

• Databricks notebooks and workspaces

• Advanced proficiency in Python and/or Scala

• Strong SQL development expertise

• Experience with data ingestion, transformation, ETL/ELT and data modelling

• Experience designing and orchestrating enterprise data pipelines

• Strong understanding of data quality, scalability and performance optimization

Sales Incentive Compensation Experience

• Functional and technical experience with Sales Incentive Compensation processes

• Understanding of incentive-plan design and compensation rules

• Experience supporting quota allocation and management

• Knowledge of sales-attainment calculations

• Experience with commission calculation and payout processing

• Ability to model complex incentive rules within data pipelines and transformation logic

• Experience partnering with Sales Operations and Finance stakeholders

Cloud and Integration Experience

• Experience integrating Databricks with at least one major cloud platform:

• Microsoft Azure

• Amazon Web Services

• Google Cloud Platform

• Experience working with integration and ingestion technologies such as:

• Azure Data Factory

• Azure Event Hubs

• Apache Kafka

• Comparable cloud-based data-integration tools

• Ability to create holistic, end-to-end data solutions rather than isolated pipelines

Professional Capabilities

• Strong stakeholder-management and consulting skills

• Ability to translate complex business requirements into scalable data architectures

• Excellent analytical and problem-solving capabilities

• Strong written and verbal communication skills

• Ability to work effectively with cross-functional teams

• Resourceful and comfortable working with minimal direction

• Strong technical-documentation skills

• Ability to manage competing priorities and deadlines

• Bachelor’s degree in Computer Science, Data Engineering, Information Technology or a related discipline

Preferred Experience

• Experience integrating Databricks with platforms such as:

• Anaplan

• Oracle Incentive Compensation

• Varicent

• Comparable Sales Performance Management platforms

• Databricks Certified Data Engineer Associate certification

• Databricks Certified Data Engineer Professional certification

• Experience using Photon to improve query and workload performance

• Previous experience within insurance, financial services or another large regulated enterprise

• Experience delivering auditable financial or compensation-related data solutions

The Ideal Candidate

The ideal candidate will be an experienced Databricks engineer who understands that compensation data requires exceptional accuracy, traceability and control.

You will be comfortable moving between detailed technical development and strategic conversations with Finance, Sales Operations and technology leaders. You should be willing to challenge requirements constructively, propose stronger architectural solutions and take ownership of delivery from initial design through testing, deployment and production support.

Most importantly, you will be able to combine enterprise data-engineering expertise with a practical understanding of how incentive plans, quotas, attainment calculations, commissions and payouts operate.

Contract Details

• Initial Contract: Six months

• Hourly Rate: Approximately $75 per hour

• Location: New York, New York

• Working Arrangement: Hybrid

• Visa Sponsorship: Not available

• Relocation Assistance: Not available

Ready to Build Business-Critical Data Solutions?

If you have deep Databricks expertise and experience translating complex Sales Incentive Compensation processes into scalable, accurate and auditable data solutions, this position offers the opportunity to make an immediate impact within a major enterprise environment.

Senior Revenue Cycle Business Analyst – Remote USA | Epic Clarity Certified

Senior Revenue Cycle Business Analyst
Remote | Full-Time | United States

This is an exciting opportunity for a highly analytical and technically advanced Revenue Cycle professional to join a forward-thinking healthcare organisation driving innovation across enterprise analytics and operational performance.

Ideal for candidates with deep expertise in Epic Clarity, healthcare billing data, and business intelligence technologies, this role offers the chance to influence strategic decision-making through advanced analytics, predictive modelling, and enterprise reporting initiatives.

This is a fully remote opportunity, providing flexibility while working on high-impact projects within a complex healthcare environment.

The Opportunity

Reporting into senior analytics leadership, you will play a key role in developing and delivering enterprise-level Revenue Cycle reporting, insights, and data solutions that directly support operational strategy and financial performance.

You will:

• Design, develop, test, and deploy enterprise reporting solutions and dashboards

• Analyse complex hospital and professional billing datasets to drive operational insight and accountability

• Collaborate with business leaders, analysts, and stakeholders to define analytical requirements and reporting strategies

• Develop predictive and prescriptive analytics models supporting denials management, AR optimisation, and cash forecasting

• Build and maintain certified datasets serving as the central source for Revenue Cycle KPI reporting

• Leverage SQL, Tableau, Crystal Reports, and advanced analytics tools to support enterprise decision-making

• Lead or contribute to strategic analytics and data governance initiatives

• Translate complex analytical findings into concise executive-level presentations and recommendations

• Drive continuous improvement and modernisation across reporting and business intelligence capabilities

Compensation & Benefits

• Salary: $78,000 – $113,000

• Schedule: Full-Time

• Location: Fully Remote within the United States

• Sign-On Bonus: Not offered

• Relocation Assistance: Not required

Comprehensive Benefits Package Includes:

• Medical, Dental, and Vision Insurance

• Life Insurance

• Retirement Plan

• Generous Paid Time Off

• Additional wellbeing and professional development programs

What Makes This Role Stand Out

• Fully remote opportunity with strong work-life flexibility

• High visibility across Revenue Cycle and Analytics leadership teams

• Opportunity to work with enterprise-scale healthcare data environments

• Exposure to advanced predictive analytics and business intelligence initiatives

• Strong focus on innovation, data governance, and operational transformation

• Collaborative culture that values analytical thinking, continuous improvement, and strategic impact

Candidate Profile

Essential Requirements:

• Epic Revenue Data Model (Clarity) Certification

• 3+ years of Revenue Cycle, managed healthcare, or insurance operations experience

• Strong understanding of Hospital Billing and Professional Billing data

• Advanced expertise with SQL, Tableau, and Crystal Reports

• Strong knowledge of relational databases, data modelling, and OLAP technologies

• Bachelor’s degree in Health Informatics, Finance, or related field

Preferred Qualifications:

• Master’s degree in Health Informatics, Business, Public Health, or related field

• Experience developing standardised Revenue Cycle KPI datasets and governance frameworks

• Experience building predictive analytics and root cause analysis models

• Exceptional communication and stakeholder engagement skills

• Strong analytical mindset with the ability to work independently in fast-paced environments

This is an excellent opportunity for a Senior Revenue Cycle Analyst seeking a role that combines advanced analytics, enterprise visibility, technical innovation, and meaningful operational impact within a complex and evolving healthcare environment.

Cloud Data Architect | AWS & Snowflake | Ridgefield, CT (Hybrid) | $170K–$210K

☁️ Cloud Data Architect

Before reading further, here are three non-negotiables that the client has made absolutely clear:

This is a Direct Hire (W2) permanent position. No C2C, no 1099, no third parties.

Candidates must NOT require sponsorship now or in the future. We can only consider US Citizens or Green Card holders who can work long-term without restriction.

The role is Hybrid — non-negotiable. You must be onsite 2–3 days per week in Ridgefield, CT, so candidates must already live within commuting distance or be willing to relocate.
(The good news: the company offers excellent benefits and is open to relocation support or a sign-on bonus for the right hire.)

📍 Location: Ridgefield, Connecticut (Hybrid – 2–3 days onsite per week)
🏢 Industry: Pharmaceutical / Biotech / Information Technology
🎓 Education: Bachelor’s degree in Computer Science, Information Technology, or related field (or 10+ years equivalent IT experience)
💼 Experience Level: Mid–Senior (7–10 years)
🚫 Visa Sponsorship: Not available
🚚 Relocation: Available for ideal candidate
💰 Compensation: $170,000 – $210,000 base salary + benefits + potential performance bonus
🕓 Employment Type: Full-Time | Permanent

🌟 The Opportunity

Join a global leader in life sciences as a Cloud Data Architect, driving innovation and digital transformation within the Enterprise Data, AI & Platforms organization.

In this role, you’ll design and implement scalable, secure, and intelligent cloud-based data architectures that power analytics, AI, and digital products across the business. You’ll partner with data leaders, business stakeholders, and cross-functional technology teams to shape how data is collected, managed, and transformed into actionable insights.

If you’re passionate about modern data ecosystems, cloud architecture, and leveraging AI-driven solutions to impact patient outcomes — this is an opportunity to make a global difference.

🧭 Key Responsibilities

• Design and implement efficient, scalable cloud-based data architectures that align with business and technology goals.

• Develop and optimize data models, schemas, and database designs supporting structured and unstructured data.

• Collaborate with business stakeholders, data domain owners, and data scientists to define data requirements and implement robust solutions.

• Lead data modernization projects and support cloud migration strategies using AWS technologies.

• Partner with governance teams to establish and maintain data policies, access frameworks, and sharing standards.

• Enhance data pipelines for ingestion, transformation, and integration of diverse datasets across domains.

• Provide technical leadership and mentorship to data engineering and development teams.

• Stay ahead of emerging data technologies, AI/ML innovations, and architectural best practices to drive continuous improvement.

🧠 Core Qualifications

✅ 7+ years in data management and architecture, including experience as a Data Architect.
✅ 5+ years hands-on experience with cloud platforms (AWS required) and enterprise data solutions.
✅ Proven track record leading cloud modernization or data transformation projects.
✅ Strong experience with AWS components (S3, Glue, Lambda), Snowflake, Apache Parquet, and SQL/NoSQL databases.
✅ Proficiency with ETL tools such as dbt, SnapLogic, and middleware integrations.
✅ Expertise in data modeling, data pipeline optimization, and semantic data structures.
✅ Experience developing Knowledge Graphs and semantic data models using ontologies and taxonomies.
✅ Understanding of AI/ML data pipelines, including use cases in NLP, recommendation engines, and predictive analytics.
✅ Deep knowledge of data governance, quality, and lifecycle management.
✅ Excellent communication and collaboration skills to effectively engage technical and business teams.

💡 Preferred Skills & Certifications

⭐ AWS Solutions Architect certification (Associate or Professional).
⭐ Familiarity with Innovator or similar enterprise architecture tools.
⭐ Experience within pharmaceutical or biotech industries — particularly in commercial data domains or GxP environments.
⭐ Strong analytical and problem-solving mindset, with the ability to defend and present technical design decisions.
⭐ Exposure to Agile/Scrum delivery models and distributed global teams.

💰 Compensation & Benefits

💵 Base Salary: $170,000 – $210,000 (commensurate with experience)
🎯 Bonus: Role-specific or performance-based
💎 Benefits Include:

• Comprehensive medical, dental, and vision coverage

• Paid time off, holidays, and flexible hybrid schedule

• 401(k) retirement plan with company match

• Wellness, family support, and professional development programs

• Global collaboration and mobility opportunities

🧩 Candidate Snapshot

• Experience: 7–10 years in data architecture and cloud systems

• Specialization: AWS Cloud | Data Modeling | ETL | Data Pipeline Design | Data Governance

• Certifications: AWS Solutions Architect (preferred)

• Seniority: Mid–Senior

• Work Arrangement: 2–3 days onsite in Ridgefield, CT

• Travel: Occasional

🌍 Why This Role Matters

This position sits at the heart of the company’s global data strategy — shaping how data is collected, structured, and leveraged to accelerate drug discovery, digital medicine, and patient outcomes. You’ll be part of a collaborative, innovation-driven environment where your work has a tangible impact on global healthcare advancements.

🚀 Ready to architect the future of cloud data innovation?
Join a team that’s transforming how data powers scientific breakthroughs and smarter decision-making — for patients, healthcare providers, and communities worldwide.

Lead Data Scientist | Houston, TX | $125K–$140K + Equity + Hybrid Flexibility

Lead Data Scientist

Location: Houston, TX (Onsite)
Level: Senior
Reports To: Director of Data Science
Salary Range: $125,000 – $140,000 (USD)
Benefits: Medical, Dental, Vision, Life Insurance, Retirement, Equity, Paid Time Off, Work From Home Flexibility

About the Role

We are seeking a Lead Data Scientist to spearhead transformative projects that drive impact across the organization. This is a hands-on leadership role where you’ll design advanced models, mentor a team of talented data scientists, and partner with senior stakeholders to solve complex challenges. If you thrive at the intersection of technology, business strategy, and innovation, this role offers the perfect platform to showcase your expertise.

What You’ll Do

• Lead high-visibility projects that directly influence business strategy and decision-making.

• Develop and deploy custom algorithms, models, and predictive analytics that unlock value from complex data sets.

• Translate technical insights into clear, compelling stories for executive-level audiences.

• Mentor and coach junior data scientists, elevating the technical capabilities of the team.

• Research and implement cutting-edge machine learning techniques to improve operational performance.

• Partner with cross-functional teams to identify opportunities, resolve data challenges, and optimize processes.

• Stay at the forefront of emerging tools and vendors, recommending best-fit solutions.

What You Bring

• 7+ years of professional experience in data science, with proven project leadership.

• Strong background in machine learning, advanced statistical modeling, and SQL database management.

• Experience in healthcare data, EHR systems, or financial/revenue cycle data preferred.

• Demonstrated ability to design scalable solutions using AWS (certification required).

• Hands-on expertise in Cogito and other data management platforms.

• Exceptional communication skills – able to engage both technical teams and executive stakeholders.

• A problem-solving mindset with the ability to thrive in fast-paced, multidisciplinary environments.

Interview Process

1. Recruiter Interview

2. Hiring Manager Interview

3. Panel Interview

Why Join Us?

Here, your work won’t just be about numbers – it will be about impact. You’ll have the chance to combine advanced data science with real-world problem solving, shaping decisions that matter.

We celebrate growth, encourage innovation, and foster a culture of collaboration. You’ll be supported by mentors, inspired by peers, and empowered to chart your own career path. Our workplace has been consistently recognized as one of the Top Workplaces in the region, a testament to our values-driven culture and commitment to meaningful work.

Benefits at a Glance

• Comprehensive medical, dental, and vision insurance

• Life insurance and retirement plans

• Equity opportunities

• Generous paid time off

• Flexible work-from-home options