Databricks Data Engineer – Sales Incentive Compensation | New York, NY

Databricks Data Engineer – Sales Incentive Compensation

📍 Location: New York, New York
🏢 Work Arrangement: Hybrid
📄 Contract Length: Six Months
💰 Hourly Rate: Approximately $75 per hour
💼 Employment Type: Contract
🚫 Visa Sponsorship: Not Available
🚚 Relocation Assistance: Not Available
🏦 Industry: Insurance and Financial Services

Build the Data Infrastructure Behind Enterprise Sales Compensation

A leading global organization is seeking an experienced Databricks Data Engineer to design, develop and optimize enterprise data solutions supporting analytics, performance reporting and Sales Incentive Compensation.

This is not purely a pipeline-development position. The successful candidate will combine strong Databricks engineering expertise with an understanding of incentive compensation processes, including quota allocation, attainment calculations, commission processing and payout reporting.

You will work closely with Sales Operations, Finance, Business Intelligence and technology teams to translate complex business rules into scalable, accurate and auditable data solutions.

Why This Opportunity Stands Out

This opportunity will allow you to:

• Own the design and development of enterprise Databricks solutions

• Influence the wider Databricks architecture and technical roadmap

• Build data pipelines supporting business-critical compensation processes

• Work with Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows

• Translate complex incentive-plan rules into reliable transformation logic

• Improve automation, integration, data quality and platform performance

• Partner directly with senior Finance, Sales Operations and technology stakeholders

• Deliver solutions that directly influence commission and compensation accuracy

What You’ll Be Doing

Databricks Architecture and Engineering

• Design, develop and implement scalable Databricks-based data solutions

• Build and maintain data pipelines supporting ingestion, transformation, reporting and analytics

• Develop data models, Delta Lake tables, notebooks and reporting datasets

• Take ownership of the overall Databricks architecture

• Ensure new pipelines and enhancements integrate effectively with existing workflows

• Maintain and optimize Databricks workspaces, pipelines and orchestration processes

• Identify opportunities to improve automation, performance and data integration

• Design reliable ETL and ELT processes across multiple enterprise data sources

Sales Incentive Compensation

• Build data pipelines supporting Sales Incentive Compensation processes

• Translate incentive-plan rules into accurate and auditable data transformations

• Support quota allocation and quota-management processes

• Develop logic for attainment tracking and performance calculations

• Support commission calculations and payout processing

• Produce reliable datasets for compensation reporting and reconciliation

• Work closely with Sales Operations and Finance to understand plan structures and business rules

• Ensure calculation logic is transparent, documented and capable of being audited

• Integrate incentive-compensation platforms with enterprise data and analytics solutions

Performance and Data Quality

• Test, debug and optimize Databricks pipelines and notebooks

• Investigate and resolve data-quality, performance and integration issues

• Improve the reliability and efficiency of existing workflows

• Implement appropriate controls and validation processes

• Monitor data pipelines and troubleshoot failures or inconsistencies

• Deliver a high-quality experience for analysts and other data consumers

Stakeholder and Technical Collaboration

• Work with business stakeholders to understand complex data requirements

• Translate functional requirements into scalable technical architectures

• Challenge requirements constructively when a more effective solution is available

• Partner with Finance, Sales Operations, IT and Business Intelligence teams

• Provide technical support to analysts and end users

• Communicate technical concepts clearly to both technical and non-technical audiences

• Manage multiple priorities within a fast-paced enterprise environment

Documentation and Platform Development

• Document data architectures, models, pipelines and configuration decisions

• Produce clear technical specifications and development documentation

• Maintain documentation to support knowledge transfer and long-term platform ownership

• Stay current with Databricks capabilities and platform enhancements

• Identify opportunities to use features such as Unity Catalog, Delta Live Tables and Photon

What You’ll Bring

Essential Databricks and Data Engineering Experience

• At least seven years of professional data-engineering experience

• A minimum of three years of hands-on Databricks experience

• Extensive experience building and managing production Databricks solutions

• Strong knowledge of:

• Delta Lake

• Delta Live Tables

• Unity Catalog

• Databricks Workflows

• Databricks notebooks and workspaces

• Advanced proficiency in Python and/or Scala

• Strong SQL development expertise

• Experience with data ingestion, transformation, ETL/ELT and data modelling

• Experience designing and orchestrating enterprise data pipelines

• Strong understanding of data quality, scalability and performance optimization

Sales Incentive Compensation Experience

• Functional and technical experience with Sales Incentive Compensation processes

• Understanding of incentive-plan design and compensation rules

• Experience supporting quota allocation and management

• Knowledge of sales-attainment calculations

• Experience with commission calculation and payout processing

• Ability to model complex incentive rules within data pipelines and transformation logic

• Experience partnering with Sales Operations and Finance stakeholders

Cloud and Integration Experience

• Experience integrating Databricks with at least one major cloud platform:

• Microsoft Azure

• Amazon Web Services

• Google Cloud Platform

• Experience working with integration and ingestion technologies such as:

• Azure Data Factory

• Azure Event Hubs

• Apache Kafka

• Comparable cloud-based data-integration tools

• Ability to create holistic, end-to-end data solutions rather than isolated pipelines

Professional Capabilities

• Strong stakeholder-management and consulting skills

• Ability to translate complex business requirements into scalable data architectures

• Excellent analytical and problem-solving capabilities

• Strong written and verbal communication skills

• Ability to work effectively with cross-functional teams

• Resourceful and comfortable working with minimal direction

• Strong technical-documentation skills

• Ability to manage competing priorities and deadlines

• Bachelor’s degree in Computer Science, Data Engineering, Information Technology or a related discipline

Preferred Experience

• Experience integrating Databricks with platforms such as:

• Anaplan

• Oracle Incentive Compensation

• Varicent

• Comparable Sales Performance Management platforms

• Databricks Certified Data Engineer Associate certification

• Databricks Certified Data Engineer Professional certification

• Experience using Photon to improve query and workload performance

• Previous experience within insurance, financial services or another large regulated enterprise

• Experience delivering auditable financial or compensation-related data solutions

The Ideal Candidate

The ideal candidate will be an experienced Databricks engineer who understands that compensation data requires exceptional accuracy, traceability and control.

You will be comfortable moving between detailed technical development and strategic conversations with Finance, Sales Operations and technology leaders. You should be willing to challenge requirements constructively, propose stronger architectural solutions and take ownership of delivery from initial design through testing, deployment and production support.

Most importantly, you will be able to combine enterprise data-engineering expertise with a practical understanding of how incentive plans, quotas, attainment calculations, commissions and payouts operate.

Contract Details

• Initial Contract: Six months

• Hourly Rate: Approximately $75 per hour

• Location: New York, New York

• Working Arrangement: Hybrid

• Visa Sponsorship: Not available

• Relocation Assistance: Not available

Ready to Build Business-Critical Data Solutions?

If you have deep Databricks expertise and experience translating complex Sales Incentive Compensation processes into scalable, accurate and auditable data solutions, this position offers the opportunity to make an immediate impact within a major enterprise environment.

Sr. Principal Full Stack Software Engineer – Data Analytics | Ridgefield, CT | $140k–$210k

💻 Sr. Principal / Lead Software Engineer – Full Stack (Data Analytics)

Before reading further, here are three non-negotiables that the client has made absolutely clear:

This is a Direct Hire (W2) permanent position. No C2C, no 1099, no third parties.

Candidates must NOT require sponsorship now or in the future. We can only consider US Citizens or Green Card holders who can work long-term without restriction.

The role is Hybrid — non-negotiable. You must be onsite 2–3 days per week in Ridgefield, CT, so candidates must already live within commuting distance or be willing to relocate.
(The good news: the company offers excellent benefits and is open to relocation support or a sign-on bonus for the right hire.)

📍 Location: Ridgefield, Connecticut (Hybrid – 2–3 days onsite per week)
🏢 Industry: Pharmaceutical / Biotech / Data & AI
🎓 Education: Bachelor’s or Master’s in Computer Science, MIS, or related field
💼 Experience Level: Mid–Senior / Principal (7–10+ years)
🚫 Visa Sponsorship: Not available
🚚 Relocation: Available for ideal candidate
💰 Compensation: $140,000 – $210,000 base salary + full benefits + bonus eligibility
🕓 Employment Type: Full-Time | Permanent

🌟 The Opportunity

Join a world-class Enterprise Data, AI & Platforms (EDP) organization on a mission to harness the power of data and artificial intelligence to transform global healthcare.

As a Full Stack Software Engineer (Lead or Principal level), you’ll design and deliver cloud-native data analytics applications that power advanced insights, innovation, and decision-making across a global enterprise. This role offers the chance to work across the entire stack — from scalable back-end systems and APIs to dynamic data visualizations — while collaborating with multidisciplinary teams in a fast-paced, agile environment.

If you’re passionate about building modern data-driven applications and leading technical excellence, this is your opportunity to make a measurable impact on the future of healthcare and digital innovation.

🧭 Key Responsibilities

• Full Stack Development: Design, develop, and maintain cloud-based applications and services, encompassing front-end and back-end systems.

• Data Analytics Engineering: Build and optimize data pipelines (ETL/ELT) using tools such as AWS Glue, Databricks, and dbt.

• Architecture Integration: Develop serverless back-end solutions using AWS Lambda, API Gateway, and related technologies.

• Visualization & Insights: Build intuitive dashboards and visualization layers using Tableau or Power BI.

• DevOps & Automation: Leverage Git, Jenkins, Docker, and Kubernetes to automate builds, testing, and deployments.

• Agile Collaboration: Work closely with product owners and cross-functional teams in an agile environment to deliver iterative, high-value releases.

• Quality & Testing: Implement robust testing frameworks and continuous integration pipelines to ensure reliability and scalability.

• Mentorship & Leadership: Guide junior developers, contribute to architectural decisions, and champion best practices across engineering teams.

🧠 Required Skills & Experience

✅ 7+ years of professional software development experience, including full-stack data analytics applications.
✅ Proven experience in cloud environments (AWS required) — strong knowledge of Lambda, API Gateway, S3, Glue, and Databricks.
✅ Solid experience building data pipelines (ETL/ELT) using AWS Glue, Databricks, and dbt.
✅ Hands-on expertise with frontend visualization tools like Tableau and Power BI.
✅ Familiarity with containerization and continuous deployment tools (Docker, Kubernetes, Jenkins).
✅ Working knowledge of API integration, serverless architectures, and data security best practices.
✅ Strong communication skills, collaborative mindset, and the ability to mentor and inspire technical teams.

💡 Preferred Skills & Attributes

⭐ Background in pharmaceutical or digital healthcare technology (preferred, not required).
⭐ Experience in agile environments, continuous improvement, and cross-functional collaboration.
⭐ Familiarity with software testing frameworks, QA automation, and CI/CD pipelines.
⭐ A passion for data, AI, and modern analytics solutions that drive business transformation.
⭐ Ability to balance hands-on technical work with strategic architectural leadership.

💰 Compensation & Benefits

💵 Base Salary: $140,000 – $210,000 (commensurate with experience)
🎯 Bonus: Role-based and/or performance incentive
💎 Benefits Include:

• Comprehensive health, dental, and vision coverage

• 401(k) with company match

• Paid holidays, vacation, and flexible hybrid work schedule

• Professional development, mobility, and career growth opportunities

• Relocation assistance for the ideal candidate

🧩 Candidate Snapshot

• Experience: 7–10+ years full-stack development (data analytics focus)

• Core Skills: AWS Cloud | ETL/ELT | Databricks | dbt | Tableau | Power BI | Lambda | API Gateway | DevOps

• Seniority: Lead or Principal Engineer

• Work Arrangement: 2–3 days onsite in Ridgefield, CT

• Travel: Occasional

🌍 Why This Role Matters

This role sits at the intersection of software engineering, data analytics, and AI innovation — driving systems that shape the way global teams make data-driven decisions in research, medicine, and operations. You’ll collaborate with visionary technologists and scientists to build solutions that turn complex data into actionable intelligence — ultimately improving lives around the world.

🚀 Ready to engineer the future of data-driven healthcare?
Join a global organization where technology, data, and purpose intersect to deliver meaningful impact — one application at a time.

Software Development Engineer | C# / SQL | $80/hr Contract | Hybrid – Melville, NY

Software Development Engineer
Location: Melville, NY (Hybrid, 3 days onsite)
Industry: Consumer Electronics
Experience Level: Mid-Senior
Employment Type: Contract
Contract Length: 6 Months
Work Hours: 35 hours/week (7 hours/day)
Pay Rate: $80 per hour
Relocation Assistance: No
Visa Sponsorship: Not Available

Exciting Opportunity for a Software Development Engineer!

Are you a talented software engineer looking to take your career to the next level? Join a dynamic team where you'll work on cutting-edge software solutions, contribute to product innovation, and collaborate with a skilled group of professionals. This role offers an exciting opportunity to develop and enhance applications that drive technological advancements in consumer electronics.

What You’ll Do:

• Design, develop, and test software applications and system enhancements.

• Work on diverse technical challenges requiring in-depth analysis and problem-solving.

• Engage in all phases of the software development lifecycle, including requirements gathering, design, coding, and testing.

• Optimize C# algorithms and SQL transactions for improved performance.

• Maintain and enhance existing applications while developing new solutions.

• Utilize cutting-edge technologies like ASP.Net, ASP.NET Core, MSSQL Server, IIS, and Azure DevOps.

• Develop automation solutions and ETL processes.

• Create and maintain reports to support business intelligence.

• Proactively identify areas for improvement and drive innovation.

What You Bring to the Table:

• 5+ years of professional programming experience.

• Expertise in C#, SQL, JavaScript, XML, and HTML (C# and SQL are top priorities).

• Proven success in optimizing C# algorithms and SQL transactions.

• Strong experience with ASP.Net, ASP.NET Core, MSSQL Server, IIS, and Azure DevOps.

• Hands-on experience with ETL processes, automation, and application maintenance.

• Excellent problem-solving skills and a self-starter attitude—someone who takes initiative without being told.

• Strong communication and collaboration skills.

Bonus Skills:

• Experience with Power Platform, Power Apps, Power Automate, and Power BI.

If you're passionate about developing high-impact software solutions and thrive in a fast-paced environment, we’d love to hear from you! Apply today and be part of an innovative team that’s shaping the future of technology.