Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSON
Tasks
- Build distributed processing pipelines with Apache Spark
- Design data egress pathways
- Design data ingress pathways
- Develop bash scripts to automate processes
- Implement analytics data processing workflows
- Optimize reliable scalable data processing
- Orchestrate schedule and monitor workflows with Apache Airflow
- Process and query large datasets with SQL
- Use Jupyter Notebook for data analysis
Perks/Benefits
- 401k contribution
- AD and D insurance
- Dental insurance
- Direct hire only
- HSA contribution
- Health insurance
- Life insurance
- Long-term disability
- Paid time off
- Short-term disability
- Vision insurance
Skills/Tech-stack
Apache Airflow | Apache Spark | Bash | CSV | Confluence | Git | JSON | Java | Jira | Jupyter Notebook | Linux | MariaDB | MySQL | NumPy | Pandas | Parquet | PostgreSQL | Python | SQL | Slurm | XML
Education
Related jobs
-
Sr. Embedded Controls Engineer – Scanning Systems USD 140K-175KADC | BLDC | Brushed DC | C# | Domain analysisSenior-level Full TimeMountain View, CA8h ago
-
Staff Software Engineer, Backend (Online Storage) USD 230K-290KAWS | Capacity Planning | Database Benchmarking | Disaster Recovery | Distributed SQLDental and vision coverage | Employee stock purchase plan | Flexible spending wallets | Health care coverage | Remote work flexibilitySenior-level Full TimeRemote US R9h ago
-
A/B | A/B Testing | API Integration | Airflow | Attribution ModelingCross-functional collaboration | Remote workSenior-level Full TimeUnited States R9h ago
-
C# | C++ | CI/CD | CUDA | Computer Architecture401k | Dental insurance | FSA | Health insurance | Office snacksSenior-level Full TimeMountain View, California, United States10h ago
-
Lead Data Engineer USD 125K-160KBigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform401k | Commuter benefits | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeColumbia, MD, United States10h ago
-
Data Engineer - Databricks USD 172K-237KACID transactions | Airflow | Auto Loader | Azure Data | Azure Data FactoryMid-level Full TimeChicago, IL, United States10h ago
-
Senior Applied ML Engineer – LLMs & NLP USD 140K-175KConvolutional Neural Networks | Human-in-the-loop | Information Extraction | Java | Language ModelingDaily group classes | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States11h ago
-
AWS and Azure Data Governance Engineer USD 116K-146K800-53 | AWS CLI | AWS CloudFormation | AWS CloudWatch | AWS Cost ExplorerSenior-level Full TimeWashington, DC11h ago
-
Senior AI Systems Engineer – LLM & Agentic Systems USD 140K-160KAWS | Agentic AI | Alerting | Drift Detection | EmbeddingsDaily group classes | Dry cleaning benefits | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R11h ago
-
Staff Data Scientist (AI/ML) USD 174K-278KAWS | Agile | Azure | BigQuery | Causal InferenceFlexible work optionsSenior-level Full TimeUS - Boston, MA ; US …11h ago
-
Lead ML Engineer USD 170K-210KAWS | Cloud infrastructure | Cloud platform | Computer Vision | Cost OptimizationExecutive-level Full TimeEnglewood Cliffs, NEW JERSEY, United States12h ago
-
Senior, ML Engineer - 3D Reconstruction USD 177K-212KActive Learning | CI/CD | Cloud services | Deep learning | Docker401k match | AD and D insurance | Company holiday closures | Flexible schedule | Life insuranceSenior-level Full TimeAnn Arbor, MI, Remote - US R13h ago
-
Software Engineer 2 - Python/PySpark/AWS USD 130K-270KAWS Glue | AWS Lambda | Amazon DynamoDB | PySpark | Python401k contribution | Health insurance | Life insurance | Paid time offSenior-level Full TimeAnnapolis Junction, MD13h ago
-
Staff Software Engineer - Experimentation USD 265K-331KAWS | CI/CD | Cloudflare | DBT | Data Pipelines13 paid holidays | 16-week parental leave | 401k | Carrot Fertility Membership | Carrot fertility reimbursementSenior-level Full TimeRemote R13h ago
-
MapReduce | NoSQL | NumPy | Pandas | SQL401k contribution | Accidental death and dismemberment insurance | Health Savings Account contribution | Life insurance | Long-term disabilitySenior-level Full TimeAnnapolis Junction, MD13h ago
-
Ai Engineer USD 150K-170KApache Airflow | Artificial Intelligence | Azure Data | Azure Data Factory | Azure DevOps401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractBaltimore, Maryland, USA R14h ago
-
AI Search | Application Insights | Application diagnostics | Azure AI | Azure AI Search401k | Dental insurance | Educational assistance | Health savings account | Life insuranceMid-level Full TimeNew York, United States R15h ago
-
Intelligent Systems Engineer II USD 98K-166KAPIs | AWS Lambda | AWS S3 | Amazon Web Services | Artificial Intelligence401k match | Community service day | Dental insurance | Flexible spending accounts | Life insuranceMid-level Full TimeWest Chester, OH, United States15h ago
-
Intelligent Systems Engineer II USD 98K-166KAPI Gateway | APIs | AWS | Artificial Intelligence | Automated testing401k match | Community service day | Flexible spending accounts | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeWest Chester, OH, United States15h ago
-
AWS | Amazon Athena | Amazon EMR | Amazon S3 | Apache AirflowEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeNashville, TN15h ago
-
Access Control | Alerting | Amazon Athena | Amazon EMR | Amazon S3Employee discounts | Employee equity | Medical, dental, and vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R15h ago
-
Bash | Command Line | Command-line Interface | Data Tiering | Dell PowerScaleContract-to-hire | Hybrid work | Unlimited growthSenior-level Full TimeNashville, TN16h ago
-
Microsoft AI Engineer USD 20K-30K.NET | AI Search | AI Studio | AI workflows | Agentic AI401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilityEntry-level ContractOmaha, Nebraska, USA R17h ago
-
Entry-level Full TimeUnited States17h ago
-
Senior AI Engineer USD 130K-200K.NET | Azure | Azure OpenAI | C# | Docker401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractOmaha, Nebraska, USA R17h ago