Data Engineer Automation Controls
Irving, TX; Sunnyvale, CA; Sunnyvale, CA; Sunnyvale, CA; Dallas, TX; Portland, OR
A USD 110K-160K (estimate) Mid-level Full Time
Tasks
- Build data APIs and data delivery services
- Build data pipeline frameworks for real time delivery
- Collaborate with product owners and customers to deliver data products
- Continuously integrate and deploy code to cloud production
- Define and improve internal software architecture processes
- Design and deploy production data pipelines with Hadoop tools
- Design robust systems for long term maintenance
- Develop cloud based applications using modern technology stack
- Handle mutable data in Hadoop
- Implement machine learning with PySpark
- Leverage reusable code modules
- Support and enhance anomaly detection machine learning platform
- Transform analytical models into production solutions
- Troubleshoot JVM issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon S3 | Angular | Anomaly Detection | Apache Airflow | Apache Beam | Apache Kafka | Apache NiFi | Apache Spark | Avro | Cassandra | Continuous integration | Elasticsearch | Git | Google Cloud | HBase | HDFS | Hadoop | Hadoop YARN | Hive | JVM | Java | Jenkins | Machine Learning | MongoDB | Neo4j | NoSQL | Node.js | ORC | Parquet | PySpark | Python | React | SAS | SQL | Scala | Shell Scripting | TDD | Unit Testing | Version control
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Mid-level Full TimeSuitland, MD; Annapolis Junction, Maryland; Crystal …1h ago
-
Apache Tika | Data Visualization | Language Processing | Machine Learning | MbseMid-level Full TimeAnnapolis Junction, Maryland1h ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R1h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R1h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R1h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R1h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R1h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R1h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R1h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Toronto, Ontario; Toronto, Ontario; …1h ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R1h ago
-
AWS | Agile | Confluence | Django | Docker401k match | Career development | Dental insurance | Health insurance | HolidaysSenior-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …2h ago
-
Agile | Ansible | Apache NiFi | Automation | Continuous Monitoring401k employer contribution | Career development and training | Holiday pay | Paid health dental and vision premiums | Paid time offSenior-level Full TimeLinthicum Heights, MD; Laurel, MD; Laurel, …2h ago
-
AWS | Agile | Confluence | Data Gathering | Django401k employer contribution | Career counseling | Education and training support | Employee referral bonuses | Flexible work-life balanceMid-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …2h ago
-
API | CSS | JavaScript | Language Model | Large Language Model401k matching | Career development | Employee referral bonuses | Health, dental, vision coverage | Paid HolidaysSenior-level Full TimeFort Meade, MD; Fort Meade, MD; …2h ago
-
COTS | Cloud Security | Cloud infrastructure | GOTS | IT Operations401k employer contribution | Career counseling | Career development plans | Education and Training | Health, dental, vision coverageSenior-level Full TimeLaurel, MD; Linthicum Heights, MD2h ago
-
Cloud Security | Cloud infrastructure | IT Operations | Linux | Network Automation401k | Career development | Employee referral bonuses | Flexible work-life balance | Health, dental, and vision insuranceSenior-level Full TimeLaurel, MD; Annapolis Junction, MD; Annapolis …2h ago
-
Cloud Big Data Software Engineer USD 130K-182KAWS | Apache Spark | Azure | Distributed Systems | Docker401k matching | Birthday day off | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeTysons, VA; Aurora, CO; Chantilly, VA; …2h ago
-
Cloud Big Data Software Engineer USD 102K-215KAWS | Apache Kafka | Apache Spark | Azure | Cloud platform401k match | Birthday day off | Disability insurance | Employee and family events | Flexible work scheduleMid-level Full TimeSan Antonio, TX; Aurora, CO; Chantilly, …2h ago
-
Cloud Big Data Software Engineer USD 135K-206KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Distributed Systems401k matching | Birthday day off | Flexible work schedule | HSA or FSA | Health insurance coverageMid-level Full TimeReston, VA; Aurora, CO; Chantilly, VA; …2h ago
-
Cloud Big Data Software Engineer USD 150K-206KAWS | Apache Kafka | Apache Spark | Azure | Cloud platform30 days paid leave | 401k matching | 401k profit sharing | AFLAC | Birthday day offMid-level Full TimeHonolulu, HI; Aurora, CO; Chantilly, VA; …2h ago
-
Cloud Big Data Software Engineer USD 135K-206KAWS | Azure | Data Visualization | Distributed Systems | Docker401k matching | Birthday day off | Employee events | Flexible work schedule | HSA/FSAMid-level Full TimeChantilly, VA; Aurora, CO; Honolulu, HI; …2h ago
-
Cloud Big Data Software Engineer USD 138K-206KAWS | Azure | Distributed Systems | Docker | GCP401k matching | Birthday day off | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeAurora, CO; Chantilly, VA; Honolulu, HI; …2h ago
-
Cloud Big Data Software Engineer USD 179K-235KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data Visualization401k matching | Birthday day off | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeAnnapolis Junction, MD; Aurora, CO; Chantilly, …2h ago