Senior Engineer, Big Data - Payment Integrity/Databricks - Remote
Tasks
- Build ETL pipelines
- Build analytics data models
- Code, test, and document data systems
- Collaborate with infrastructure and vendor support
- Create scalable reliable data solutions
- Design data management architecture
- Develop reporting and analytics
- Develop streaming data pipelines
- Ensure data quality and validation
- Implement batch and real-time ingestion
- Implement data governance
- Integrate structured and unstructured datasets
- Provide technical guidance on standards and best practices
- Support audit ready datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hive | Apache Impala | Apache Kafka | Apache Kylin | Apache Phoenix | Apache Spark | Apache Spark Streaming | Apache Storm | Cloudera | Data Governance | Data Modeling | Data Quality | Data Validation | Data Warehouse | Databricks | Databricks SQL | ETL | HBase | Hortonworks | Java | Metadata Management | NoSQL | PolyBase | Presto | Python | REST API | SOAP API | Scala | Spark Streaming | Streaming | Talend
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1h ago
-
Senior Analytics Engineer USD 87K-161KAutomation | CI/CD | DBT | Data Ingestion | Data Modeling401k | Flexible workplace options | Hybrid work options | Paid time off | Remote work optionsSenior-level Full TimeRemote-FL, United States R17h ago
-
Access Controls | Azure | Azure Data | Azure Data Factory | Azure DevOpsHybrid work model | No benefits for contract position | Paid relocation not available | Remote work optionsSenior-level ContractDetroit R18h ago
-
Member of Technical Staff USD 324K-396KAmazon Web Services | Azure | BigQuery | C++ | Cloud platformTelecommuting permittedSenior-level Full TimePalo Alto, CA R21h ago
-
Data Analyst, Software Engineering Track USD 80K-100KAI Assisted Development | Cause analysis | Data Modeling | Data Pipelines | Data QualityFlexible PTO | Home office stipend | Learning Budget Reimbursement | Paid health dental and vision | Parental leaveEntry-level Full TimeBoston or Remote R21h ago
-
Customer Centric Engineer USD 144K-181KAWS | Airflow | Azure | BigQuery | DBTCoworking stipend | FSA | Fertility benefits | Health coverage | Remote workSenior-level Full TimePalo Alto, California, United States; Remote, … R22h ago
-
AI Developer USD 112K-165KContinuous Deployment | Continuous integration | Deep learning | FHIR | Fine TuningFlexible scheduling | Remote workSenior-level Full TimeUnited States R22h ago
-
Lead Data Engineer USD 160K-193KAPI | Amazon Redshift | CI/CD | DBT | ELT100 percent remote | 401k with company contribution | Adoption benefits | Comprehensive health plans | Flexible time offSenior-level Full TimeDeerfield, IL, United States R23h ago
-
Embedded Java Software Engineer USD 150K-196KAgile | Dmesg | Embedded Linux | Functional testing | GradleFully remoteSenior-level Full TimeFlorida, United States R23h ago
-
Embedded Java Software Engineer USD 130K-160KAgile | Debugging | Dmesg | Embedded Linux | Embedded SystemsFully remoteSenior-level Full TimeFlorida, United States R1d ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Cloud platform | Data Analysis | Data Visualization401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Lead Data Engineer - Data Platform Engineering (Hybrid) USD 130K-165KApache Airflow | Apache Hadoop | Apache OpenLineage | Apache Spark | BigQueryHybrid work scheduleSenior-level Full TimeMelville, Suffolk, United States R1d ago
-
Associate Director, Data Engineering (Remote) USD 130K-140KAutomated testing | CI/CD | Continuous Delivery | Continuous integration | Data Governance401k company match | Career growth opportunities | Company holidays | Generous PTO | Medical/Dental/Vision insuranceMid-level Full TimePortland R1d ago
-
C++ | Computer Architecture | Customer Integration | Embedded Systems | Machine LearningCollaborative engineering culture | Flexible working environment | Frequent travel across North America | Fully remote within United States | Professional development opportunitiesSenior-level Full TimeUnited States, United States R1d ago
-
Senior, ML Engineer - VLM USD 177K-212K3D Object Detection | AWS Athena | AWS DynamoDB | AWS ECS | AWS Lambda401k employer match | AD and D insurance | Company-Paid Holidays | Flex schedule | Life insuranceSenior-level Full TimeAnn Arbor, MI, Remote - US R1d ago
-
API Development | Backend Development | Cause analysis | Cloud Native | Data QualityFlexible paid time off | Fully remote work | Parental leave | Professional growth and developmentSenior-level Full TimeCanada R1d ago
-
Sr. Software Engineer, GenAI USD 175K-220KAWS | CI/CD | Docker | Drift monitoring | Embeddings401k | Company laptop | Company retreats | Generous PTO | Health, dental, and vision insuranceSenior-level Full TimeRemote - USA R1d ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R1d ago
-
Agentic AI Engineer (Boston, Hybrid) USD 319K-350KAI orchestration | AWS | Autogen | Azure | CrewAIEquity | Health benefits | Hybrid workMid-level Full TimeBoston R1d ago
-
Senior-level Full TimeRemot, USA, United States R1d ago
-
Staff Security Software Engineer, AI Security USD 190K-267KAI Security | AI security tooling | AWS | Adversarial ML | Audit LoggingSenior-level Full TimeRemote - California R1d ago
-
Lead Data Engineer USD 126K-165KApache Spark | Application Insights | Azure Data | Azure Data Factory | Azure MonitorOn-call support | Remote workSenior-level Full TimeUnited States - Remote, United States R1d ago
-
Data Engineer with AI/ML USD 72K-130KAWS | Agile | Apache Airflow | Azure ML | Azure ML Studio401k contribution | Career development | Comprehensive benefits | Equity stock purchase | Incentive and recognition programsMid-level Full TimePrimary location: Minnetonka, MN R1d ago
-
Edge AI Engineer USD 100K-150KBenchmarking | C++ | Core ML | DSP | Energy EfficiencyCareer growth potential | Long term multi year engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth opportunities | Full-time remote work | H1B transfer support | Long-term engagementSenior-level Full TimeUnited States - Remote R1d ago