Role
Are you a creative IT professional with strong technical aptitude who embraces changes and is passionate about data and information? We invite you to join our highly innovative data engineering team which is constantly designing, developing, and delivering high quality solutions for our customers.
As a data engineer, you will have opportunities to work in a dynamic and fast-paced environment to collaborate with business functions to design solutions. You will translate business requirements into technical needs, connect and automate data pipelines, and deliver data architecture and data governance solutions.
Responsibility
Perform IT system architecture design, new technology research, and provide recommendation.
Design and implement optimal data pipeline architecture (considered high data volume, data governance, etc.)
Work with PRODUCT/BIZ teams to assist with new data platform re-engineering or data-related technical issues
DataOps high availability NoSQL DB (e.g.: Cassandra, S3/MinIO, MariaDB, etc.) on K8s environment.
Qualification
Required
B.S. degree and above in Computer Science or related fields (Information Engineering, Information Management, Data engineering, Applied Mathematics).
Experience in Hadoop ecosystem and SQL NoSQL databases.
Big Data Solutions development, data pipelines for batch and streaming applications.
Knowledge of object stores for image and semi/unstructured data.
Metadata management, data quality assurance, data security and governance, and new data technology evaluation and enablement.
Strong analytical, problem solving, and organizational skills.
Self-motivated with the ability to work under minimal supervision.
Preferred
Experience in MongoDB, MariaDB, Cassandra, and MinIO(S3).
Data orchestration among various data sources, data parallel processing.
Ability to design solutions independently based on high-level architecture.
Cloud native deployment practices, specifically, containers and container orchestration platforms.
Personal Attributes: Critical thinker, detail oriented, high aptitude, and a good team player.
Ogłoszenie opublikowane przez Professionals Group sp. z o.o. - agencja zatrudnienia zarejestrowana w KRAZ pod nr 23835 / Advertisement published by Professionals Group sp. z o.o. an employment agency registered in KRAZ under no. 23835.