Senior Data Engineer (Databricks)
Tasks
- Architect scalable infrastructure on AWS
- Automate data delivery and validation
- Build high-performance data pipelines
- Design and evolve data architectures
- Design data models for analytics and machine learning
- Develop ETL processes
- Ensure data security and compliance
- Implement data augmentation
- Integrate APIs for data models
- Monitor performance and test for data integrity
- Optimize large-scale data processing
- Partner with AI ML engineers to identify data sources
- Write SQL queries for data extraction and analysis
Perks/Benefits
- Annual company retreat
- Company-wide winter break
- Education bonus
- Equity participation
- Optional in person events and meetups
- Paid time off
- Tailored career roadmaps
Skills/Tech-stack
API Integration | AWS | Apache Airflow | Apache Spark | Azure | Cassandra | Computer Science | Computer networks | Data Augmentation | Data Modeling | Data Processing | Data Structures | Data Validation | Data Warehousing | Data structures algorithms | Databricks | ETL | GCP | Git | Graph Databases | MongoDB | Neo4j | NoSQL | Object-Oriented | Object-oriented programming | PostgreSQL | Python | Relational databases | SQL | Snowflake | Unstructured Data
Education
N/A
Roles
Related jobs
-
Apache Spark | Data Lineage | Data Modeling | Data Quality | Data Quality ManagementRemote work | W2 employmentMid-level Full TimeChicago, IL. R7h ago
-
Senior Software Engineer, Data Infrastructure USD 191K-225KAWS EMR | Airflow | Concurrency | Distributed Systems | Fault-tolerantBonus | Employee travel credits | EquitySenior-level Full TimeUSA - Remote R17h ago
-
AI Document Intelligence | AI content understanding | API Development | Agile Kanban | Agile ScrumFlexible vacation policy | Fully remote | Home office support allowance | Indefinite contract option | Learning and development bonusMid-level Full TimeMexico R17h ago
-
Embedded Software Engineer I USD 106K-170KAlgorithms | C# | C++ | DHCP | DNSDental insurance | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsMid-level Full TimeSeattle, Washington, United States R21h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch Processing | ChunkingCommunity of Practice | Hybrid work schedule | Mentorship opportunitiesSenior-level Full TimeHartford CT- Home Office, United States R22h ago
-
Software Engineer (AI/ML) USD 110K-177KAWS | Agile | Azure | Docker | GCP401k match | Dental insurance | Employee assistance program | Health insurance | Paid parental leaveMid-level Full TimeBoston, United States R22h ago
-
Data Engineer AI USD 165K-216KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | AirflowWork-life balanceSenior-level Full TimeTelecommuter TN, United States R22h ago
-
Senior AI/ML Software Engineer USD 121K-195K.NET | APIs | AWS | Agile | Azure401k retirement plan | Employee assistance program | Flexible spending account | Flexible work environment | Health savings accountSenior-level Full TimeRemote, United States, United States R22h ago
-
Mid-level Full TimeRemote Illinois, United States R22h ago
-
AWS Solutions Architect- AI/ML USD 138K-207KAWS | AWS Bedrock | AWS CloudFormation | AWS Glue | AWS SecurityFully remote | Travel requiredSenior-level Full TimeUnited States - Remote R22h ago
-
AWS Solutions Architect- AI/ML USD 138K-207KAWS | AWS Bedrock | AWS CloudFormation | AWS Glue | AWS Well ArchitectedFully remote | Travel requiredSenior-level Full TimeUnited States - Remote R22h ago
-
AI/ML Software Engineer USD 95KAWS | Agent systems | Autogen | Azure | Cloud platform401k matching | Dental benefits | Disability insurance | Employee assistance program | Health benefitsSenior-level Full TimeEvendale, United States R22h ago
-
Credit modeling | Data Mining | Data Quality | Data Visualization | Excel401k | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeMissouri Work at Home, United States R22h ago
-
Data Engineer USD 97K-133KAPI Development | Agile | Apache Spark | Azure Data | Azure Data Factory401k retirement plan | Medical/Dental/Vision | Paid time off | Remote workMid-level Full TimeWork at Home - Kentucky, United … R22h ago
-
Database Platform Distinguished Engineer USD 140K-251KAI | AWS | Access Control | Auditing | Automation401k match | 401k plan | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R1d ago
-
Database Platform Distinguished Engineer USD 140K-251KAWS | Auditing | Automation | Azure | Backup & Recovery401k match | Dental insurance | Employee stock purchase plan | Life insurance | Medical insuranceSenior-level Full TimeUnited States R1d ago
-
Senior AI Engineer CAD 160K-220KCI/CD | Context window | Context window optimization | Contextual compression | Document chunkingHealth benefits | Home internet reimbursement | Learning & development budget | Paid personal days | Paid sick daysSenior-level Full TimeCanada (Remote) R1d ago
-
APIs | AWS ECS | AWS Lambda | AWS S3 | AgentsSenior-level Full TimeOffice Location or Remote - USA R1d ago
-
API Development | AWS | AWS Lambda | Agentic AI | Amazon EC2Senior-level Full TimeOffice Location or Remote - USA R1d ago
-
Lead, Customer Strategy Analytics & Applied AI USD 190K-210KAI workflows | Analytics | Applied AI | DBT | Data ModelingComprehensive health coverage | Equity | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States R1d ago
-
Machine Learning Engineer - New AI Initiatives USD 153K-183KData Analysis | Data Curation | Data Governance | Data Ingestion | Data Preparation401k match | Disability insurance | Flexible schedule | Life insurance | Paid medical dental and visionSenior-level Full TimeRemote - US R1d ago
-
Software Engineer, Fulfillment CAD 108K-135KAWS | Buildkite | CircleCI | Cloud Platforms | Cloud platformChild care benefits | Disability benefits | Family building benefits | Flexible paid time off | Health and dental coverageMid-level Full TimeToronto, Canada R1d ago
-
Forward Deployed AI Product Engineer USD 180K-230KAI Agents | AI guardrails | API Integration | APIs | AWSAutonomy | Career growth opportunities | Casual work environment | Remote-first culture | Travel for client workSenior-level Full TimeUS-Remote R1d ago
-
Senior Agentic AI Engineer USD 194K-239KAPI Development | Agent systems | Agentic AI | Debugging | Distributed SystemsDental insurance | Flexible work policy | Health insurance | Learning Support | Paid family leaveSenior-level Full Timesan francisconew york R1d ago
-
Software Engineer Senior BRL 210K-210KAWS | Angular | Automated testing | CI/CD | Cause analysisHybrid work modelSenior-level Full TimeSão Paulo, SP, Brazil R1d ago