Big Data Engineer ( Python )
La Fosse
AI assistant
Job Description
Essential Requirements
Candidates must demonstrate experience in the following:
- Big data technologies, particularly Hadoop, Spark and Hive
- Apache Spark, including ETL and data aggregation
- Python and PySpark
- Docker and Kubernetes virtualisation/containerisation
- Multiple database technologies, including:
- Oracle
- SQL
- SQLAlchemy
- Alembic
- PostgreSQL
- RDBMS technologies
- API development, including FastAPI
Additional Requirements
Candidates should also demonstrate:
- Strong experience with Git or a similar version-control system
- Experience building data pipelines into AWS environments
- Ability to produce testable, maintainable code
- Experience creating and executing unit