Senior Data Engineer
USD 149K-166K (estimate) Senior-level Full Time
Tasks
- Build data lake and warehouse solutions
- Create ETL and ELT pipelines
- Create project plans and documentation
- Design scalable data pipelines
- Develop business rule management systems
- Develop data workflow orchestration pipelines
- Develop event driven data platform architecture
- Develop testable maintainable software with Python
- Implement CI/CD pipelines
- Implement Kafka based messaging frameworks
- Implement data governance & compliance
- Optimize workflows performance and reliability
- Perform data validation and monitoring
- Perform testing validation and troubleshooting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Crawler | AWS Glue | AWS Lambda | Aerospike | Agile | Airflow | Alteryx | Amazon Athena | Amazon EC2 | Amazon EMR | CI/CD | Continuous Delivery | Continuous integration | DB2 | Data Lakehouse | Denodo | Docker | Drools | ELT | ETL | Econometrics | Informatica | Java | Jenkins | Kafka | Kanban | Linear Regression | Linux | Microsoft SQL | Microsoft SQL Server | MongoDB | NumPy | Oracle | PL/SQL | Pandas | PostgreSQL | PowerBI | Probability | PySpark | Python | QuickSight | Redshift | S3 | SQL | SQL Server | Scikit-learn | Scrum | Series analysis | Shell | Snowflake | Splunk | Tableau | Talend | TensorFlow | Teradata | Terraform | Time Series | Time Series Analysis | Unix | YugabyteDB
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API Integration | Agent Orchestration | Bias Mitigation | C plus plus | C#Senior-level Full TimeMenlo Park, CA | Seattle, WA …7h ago
-
Manufacturing Test Engineer, Data Center USD 120K-172KBash | Board Level Scan | Calibration | Circuit test | Correlation studyMid-level Full TimeAtlanta, GA, USA7h ago
-
Research Engineer, Frontier Safety Mitigations, DeepMind USD 174K-253KAI control | Adversarial Machine Learning | Adversarial Robustness | Anomaly Detection | Artificial IntelligenceMid-level Full TimeSan Francisco, CA, USA; Mountain View, …7h ago
-
Software Engineer III, AI/ML, Proxybidder ML USD 147K-211KC++ | Data Processing | Debugging | JAX | KerasBenefits | Bonus target | EquitySenior-level Full TimeNew York, NY, USA7h ago
-
Staff Software Engineer, Agent-Centric Data and APIs USD 207K-301KC++ | CSS | Data Engineering | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Francisco, CA, USA7h ago
-
Senior Software Engineer, AI/ML GenAI, Core USD 174K-253KC++ | Computer Vision | Data Processing | Data Storage | Data StructuresHealth insurance | Paid time off | Parental leave | Retirement plansSenior-level Full TimeSan Jose, CA, USA7h ago
-
Senior Software Engineer, Motion Algorithms USD 174K-253KBluetooth | C++ | Data Analysis | Data Structures | Data VisualizationSenior-level Full TimeMountain View, CA, USA7h ago
-
Software Engineer, Google Cloud Storage USD 147K-211KAccess Control | C++ | Chaos Engineering | Cloud Functions | Cloud StorageMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA7h ago
-
Staff Software Engineer, Cloud AI USD 207K-301KAgent Development | C++ | Cloud Computing | Cloud platform | Data StorageSenior-level Full TimeSunnyvale, CA, USA; New York, NY, …7h ago
-
Software Engineer III, Perception, XR USD 147K-211KAudio Processing | Data Processing | Java | Kotlin | Language ProcessingSenior-level Full TimeSan Jose, CA, USA7h ago
-
Machine Learning Engineer USD 130K-170KAirflow | CI/CD | DBT | Docker | ELT401k match | Dental insurance | Disability coverage | Life insurance | Medical insuranceSenior-level Full TimeNew York, NY, US10h ago
-
Strategy & Analytics Lead USD 180K-230KBusiness Intelligence | Data Modeling | Data analytics | Looker | MetabaseSenior-level Full TimeSan Francisco13h ago
-
Senior Principal Engineer- MLOps & AI Machinery, ADAS/AV USD 240K-320KASIL | Automation | Automotive Safety | Automotive hardware | Automotive safety standards401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountExecutive-level Full TimeSunnyvale, CA, United States14h ago
-
AI Software Engineer USD 100K-180KAgile | CI/CD | Code Analysis | Confluence | Data EngineeringCareer progression | World-class benefitsMid-level Full TimeAnnapolis Junction, Maryland, United States14h ago
-
AI Software Engineer-Senior USD 124K-195KAgile | Code Analysis | Confluence | Continuous Delivery | Continuous DeploymentCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States14h ago
-
Senior-level Full TimeAnnapolis Junction, Maryland, United States14h ago
-
Cloud Software Engineer-Principal USD 113K-250KBigtable | CentOS | ClearQuest | Cloud Computing | Configuration ManagementSenior-level Full TimeAnnapolis Junction, Maryland, United States14h ago
-
AI Analytic Software Engineer-Senior USD 130K-195KAWS Amplify | AWS Bedrock | Confluence | Docker | ElasticsearchCareer progression | World-class benefitsSenior-level Full TimeAnnapolis Junction, Maryland, United States14h ago
-
IT Lead Data Engineer USD 138K-170KAmazon Web Services | Artificial Intelligence | Azure DevOps | Cloud platform | Data GovernanceFlexible work options | Mentorship | Travel opportunitiesSenior-level Full TimeSan Jose, CA, United States15h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic Frameworks | Auditability | CI/CD | Cloud Native401-k match | Dental insurance | Expense Reimbursement for Home Office | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R15h ago
-
AI Solutions Engineer (Fixed-Term) USD 70K-300KAgentic Systems | Application development | Customer discovery | LLM Application Development | LLM applicationMid-level TemporaryIrvine, CA16h ago
-
Senior Analytics Engineer USD 159K-200KAWS | Airflow | DBT | Dagster | Data ObservabilityAutonomy | Fully remote | High-impact work | Use of AI toolsSenior-level Full TimeRemote US R16h ago
-
Senior-level Full TimeSan Francisco17h ago
-
Cleared Storage Design Engineer — Senior USD 90K-170KAPI Development | Active IQ | CIFS | Capacity Planning | Data Fabric ManagerSenior-level Full TimeQuantico, VA, US18h ago
-
Data Platform Engineer USD 125K-188KAPI Gateway | AWS | AWS Glue | AWS Kinesis | AWS LambdaEmployee discounts | Matching 401-K | Medical/Dental/Vision | Paid time off | Wellness programMid-level Full TimeUnited States, San Mateo, CA18h ago