Sr Data Engineer
Tasks
- Design and evolve data architecture for analytics BI and AI ML
- Design real time and batch data pipelines using Databricks and Spark
- Develop Python and Spark processes for data ingestion transformation and loading
- Improve pipeline speed scalability and reliability
- Monitor pipeline health troubleshoot data issues
- Onboard new data sources into the data warehouse
- Perform code reviews and promote testing and CICD best practices
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | CI/CD | Cloud Data | Cloud Data Pipelines | Data Pipelines | Data Warehouse | Databricks | Event Hub | Kafka | Power BI | Python | SQL | Streaming | Tableau | Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R8h ago
-
Senior-level Full TimeMountain View, CA10h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA10h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R20h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States21h ago
-
Software Engineer - X Data USD 125K-400KApache Flink | Apache Kafka | Apache Spark | BigQuery | Cause analysis401k retirement plan | Dental insurance | Discounts | Health insurance | Life insuranceMid-level Full TimePalo Alto, CA1d ago
-
Embedded Software Engineer Intern (Fall 2026) USD 108K-108KADC | Antenna Testing | C# | C++ | CANHousing stipend | Overtime pay | Paid sick time | Relocation supportEntry-level InternshipSouth San Francisco, California, USA1d ago
-
AI Engineer – Decision & Optimization Systems USD 80K-210KAMPL | C++ | CPLEX | Constraint Satisfaction | Go401k | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
AI Engineer - Allocation and Packing Systems USD 80K-210KA/B | A/B Testing | Approximation algorithms | Assignment Algorithms | B testing401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
AI Engineer – Routing & Network Optimization USD 80K-210KA Star | A Star Algorithm | AMPL | Bellman Ford Algorithm | CPLEX401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
AI Software Engineer USD 80K-210KAWS Kinesis | Apache Airflow | Apache Kafka | C# | C++401k | Equity grant | Full healthcare coverage | Unlimited PTOSenior-level Full TimeEl Segundo, CA1d ago
-
Deployment Strategist - North America USD 150K-245KAI Agent | AI Agent Frameworks | API Integration | Agent Frameworks | Agent OrchestrationAnnual company offsite | Annual travel stipend | Co-working stipend | Professional development stipendMid-level Full TimeUnited States R1d ago
-
Applied AI Engineer USD 204K-352KBackend Development | Cloud infrastructure | Deep learning | Docker | Fine TuningAnnual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insuranceSenior-level Full TimeNew York, NY (HQ)1d ago
-
ML Research Engineer - Hardware Codesign USD 185K-455KC++ | CUDA | Floating point | Floating point numerics | Functional simulationHybrid work schedule | Relocation assistanceSenior-level Full TimeSan Francisco1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Associate Quantum Engineer USD 130K-184KCryogenic Systems | Data Analysis | Data acquisition | Instrument Control | Laboratory Instrument ControlInterdisciplinary team | Mentorship | State-of-the-art facilitiesMid-level Full TimeNew Haven, CT1d ago
-
Quantum Engineer (Physicist) USD 136K-187KCircuit-QED | Cryogenics | Data Analysis | Error correction | Low temperature physicsMid-level Full TimeNew Haven, CT1d ago
-
Senior Quantum Applications Engineer - QEC USD 120K-258KCUDA-Q | Decoder algorithms | Docker | End to End | End-to-End TestingSenior-level Full TimeNew Haven, CT1d ago
-
Staff AI engineer USD 170K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Distributed SystemsFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
C++ | Deep learning | Imitation Learning | Machine Learning | PlanningHealth insurance | Life insurance | Long-term care insurance | Long-term disability insurance | Paid time offSenior-level Full TimeFoster City, CA1d ago
-
Senior AI Engineer USD 125K-145KAPI Management | AWS | Azure | Azure DevOps | C#401k plan | Career advancement | Dental insurance | Dependent care | Flexible spending accountSenior-level Full TimeCleveland, OH, United States1d ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Bitbucket | Atlassian Confluence | Atlassian Jira | Bare Metal | C++401k match | Career growth | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimePalmdale, CA; Fort Worth, TX1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago