Open source news and updates, #99

{"value":"Newsletter #99. While Nena gave you 99 red balloons, I give you the latest version of the AWS open source news letter. This week we feature more great new open source projects including a project to help you with drift detection in your CloudFormation stacks, new Terraform modules, an open-source prometheus exporter, some AWS CDK resources and sample projects and more. This weeks AWS and Community posts cover PostgreSQL, Apache Airflow, AWS CDK, Redis, GraphQL, Apollo GraphQL, Kubernetes, AWS EKS and more. Make sure you check out the Quick Updates to stay on top of whats new in your favourite open source projects. In the videos, we feature Monokle, Rust, and a getting started with Visual Flow guide. Finally, we wrap up with Events, with a few happening later this week. As always, if you have an event/meet-up you want me to feature, just drop me a message and I will include it.\n\n#### **Job of the week**\n\n[Principal Developer Advocate, Containers](https://aws-oss.beachgeek.co.uk/1b7)\n\nAmazon Web Services (AWS) is looking for a talented leader to lead the Bottlerocket and Amazon Linux Developer Advocacy program, part of Container services. Find out more, and apply via [this link](https://aws-oss.beachgeek.co.uk/1b7). If you want to have a chat about what it is like, feel free to drop me a mail.\n\n#### **Celebrating open source contributors**\n\nThe articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.\n\nSo thank you to the following open source heroes: Bhavani Ravi, Matthieu Napoli, Luc van Donkersgoed, Anouar Zaaber, Cem Altuner, Julien Grinsztajn, Amine El Mallem, Mohamed-Ali ELOUAER, Armando Segnini, Takahiro Ishii, HariKrishna Boorgadda, Rajesh Madiwale, Swanand Kshirsagar, Florian Chazal, Severin Gassauer-Fleissner, Zahi Ben Shabat, Nicolas Moutschen, Dmitri Pavlov, Gunnar Grosch and Zachariah Dzielinski.\n\nMake sure you find and follow these builders and keep up to date with their open source projects and contributions.\n\n#### **Latest open source projects**\n**Community**\n**bitesizedserverless**\n\n[bitesizedserverless](https://aws-oss.beachgeek.co.uk/1bv) AWS Hero and Community Builder Luc van Donkersgoed has created a new repo to centralise all the various projects he has been working on. Worth a check to see if you might find something useful.\n\n#### **cfn-drift-remediation**\n\n[cfn-drift-remediation](https://aws-oss.beachgeek.co.uk/1bp) Cloudar have created this tool that uses the Cloud Control API to remediate drift that was detected on a CloudFormation stack. If you want to remind yourself, [AWS Cloud Control API](https://aws-oss.beachgeek.co.uk/1bq) a set of common application programming interfaces (APIs) that are designed to make it easy for developers to manage their AWS and third-party services.\n\n#### **ssm-provisioner**\n\n[ssm-provisioner](https://aws-oss.beachgeek.co.uk/1br) this tool from Zachariah Dzielinski provides the ability to provision AWS instances via SSM using Terraform. The project provides examples of how to get started and a short reason on why Zachariah created this project.\n\n#### **coroot-aws-agent**\n\n[coroot-aws-agent](https://aws-oss.beachgeek.co.uk/1bs) is an open-source prometheus exporter that gathers metrics from AWS services.\n\n#### **aws-default-vpc-deleter**\n\n[aws-default-vpc-deleter](https://aws-oss.beachgeek.co.uk/1bo) if you are looking for a script to automate the deletion of an AWS VPC, then look no further as Cem Altuner has put together something that does exactly this. Use with caution of course, as it will delete stuff.\n\n#### **Tools**\n#### **TransactionChainsDataGenerator**\n\n[TransactionChainsDataGenerator](https://aws-oss.beachgeek.co.uk/1bi) is a random data generation program to simulate a record of bank transactions between individuals. It first generates a configurable number of parties, some of which are marked as \"suspicious\", and then a configurable number of transactions between them. Each transaction's \"originator party\" and \"beneficiary party\" are selected entirely randomly from the pool, and the transaction amount is also random. The program outputs RDF files in Turtle syntax. To see how you can use this, check out the post from Severin Gassauer-Fleissner and Zahi Ben Shabat, [Financial Crime Discovery using Amazon EKS and Graph Databases](https://aws-oss.beachgeek.co.uk/1bj)\n\n\n\n#### **single-ec2-cdk**\n\n[single-ec2-cdk](https://aws-oss.beachgeek.co.uk/1bt) This is a simple CDK project that creates a single EC2 instance and copies a common set of tools needed for doing cloud development. This script handles the undifferentiated heavy lifting of creating a development environment, including a bunch of typical tools you might need. Make sure you read the doc, which covers some nice use cases I think this project is a good fit for.\n\n#### **amazon-emr-with-delta-lake**\n\n[amazon-emr-with-delta-lake](https://aws-oss.beachgeek.co.uk/1c0) this project contains code that show how to read from and write to Delta tables with Amazon EMR and help you quickly explore the main features of Delta Lake.\n\n#### **aws-appflow-custom-connector-python**\n\n[aws-appflow-custom-connector-python](https://aws-oss.beachgeek.co.uk/1bu) Amazon AppFlow is a fully managed integration service that enables you to securely transfer data between Software-as-a-Service (SaaS) applications like Salesforce, SAP, Zendesk, Slack, and ServiceNow, and AWS services like Amazon S3 and Amazon Redshift. This project enables customers and third party developers to build custom source and/or destination connectors for the AppFlow service. If you are not a Python developer, but prefer Java, then you are in luck as you can use [aws-appflow-custom-connector-java.](https://aws-oss.beachgeek.co.uk/1bz)\n\n#### **Demos and Samples**\n#### **cdk-amazon-mwaa-cicd**\n\n[cdk-amazon-mwaa-cicd ](https://aws-oss.beachgeek.co.uk/1bc)a nice open sourced solution to automate the deployment and configuration of Managed Apache Airflow (MWAA) environments to programmatically author, schedule and monitor workflows. This repository demonstrates how one customer, ENGIE, were able to deploy a CI/CD pipeline for an Amazon MWAA project to automate the ingestion process from Salesforce using Airflow with an example. Anouar Zaaber, Julien Grinsztajn, Amine El Mallem, Mohamed-Ali ELOUAER, and Armando Segnini have collaborated in a detailed walkthrough blog post, [How ENGIE scales their data ingestion pipelines using Amazon MWAA](https://aws-oss.beachgeek.co.uk/1bd)\n\n\n\n#### **AWS and Community blog posts**\n**Apache Airflow**\n\nIn [Merging Python Modules](https://aws-oss.beachgeek.co.uk/1by) Bhavani Ravi shares lessons learned in her quest to automate the task of merging multiple Python modules into a single one for Apache Airflow, and the solution she created. [hands on]\n\n#### **Apollo GraphQL**\n\nApollo Federation is an architecture and specification used to build and connect multiple distributed backend GraphQL (micro)services, exposing a single endpoint and GraphQL schema to API clients and consumers. In [Apollo GraphQL Federation with AWS AppSync,](https://aws-oss.beachgeek.co.uk/1bh) Florian Chazal explains how to setup an Apollo Federation Gateway connected to GraphQL subgraphs powered by AWS AppSync/ [hands on]\n\n\n\n#### **PostgreSQL**\n\nIn a two part post, HariKrishna Boorgadda, Rajesh Madiwale, and Swanand Kshirsagar discuss two ways to audit your PostgreSQL databases using the pgAudit extension. Check out the first post, [Part 1: Audit Aurora PostgreSQL databases using Database Activity Streams and pgAudit](https://aws-oss.beachgeek.co.uk/1bg) and follow the link to part two in the article. [hands on]\n\n\n\n#### **Redis**\n\nTakahiro Ishii takes a look how Amazon MemoryDB for Redis is a great candidate for gaming leaderboard backends in the post, [Rethinking Game Leaderboards with Amazon MemoryDB for Redis](https://aws-oss.beachgeek.co.uk/1bf)\n\n#### **Serverless Framework**\n\nMatthieu Napoli provides a nice summary of what to expect with [Serverless v3](https://aws-oss.beachgeek.co.uk/1bx) in his post, [Serverless Framework V3 Is Live!](https://aws-oss.beachgeek.co.uk/1bw)\n\n#### **Other posts worth checking out**\n\nLast week, these posts also caught my eye.\n\n- [How to mount Linux volume and keep mount point consistency](https://aws-oss.beachgeek.co.uk/1c1) explains how to mount Linux volumes and keep mount points preserved when the instance type is changed or the instance is rebooted.\n- [Continuous Delivery of Amazon EKS Clusters Using AWS CDK and CDK Pipelines](https://aws-oss.beachgeek.co.uk/1bk) shows the use of AWS CDK and CDK Pipelines to deploy Amazon EKS clusters. [hands on]\n\n\n\n- [Evolving REST APIs with GraphQL using AWS AppSync Direct Lambda Resolvers](https://aws-oss.beachgeek.co.uk/1be) learn how to use resources from an existing REST API built with AWS Serverless Application Model SAM, AWS API Gateaway, and AWS Lambda to work as AWS AppSync Direct Lambda Resolvers. [hands on]\n- [Use AWS Systems Manager custom Inventory to locate Log4j files on managed nodes](https://aws-oss.beachgeek.co.uk/1bl) will show you how to use AWS System Manager's custom inventory data type to locate Log4j JAR files on Windows and Amazon Linux EC2 instances and hybrid managed nodes. [hands on]\n- [Migrate SQL Server to Amazon Aurora PostgreSQL using best practices and lessons learned from the field](https://aws-oss.beachgeek.co.uk/1bm) find out everything you need to successfully re-architect and migrate SQL Server to Aurora PostgreSQL.\n\n#### **Quick updates**\n**Apache Cassandra**\n\nAmazon Keyspaces (for Apache Cassandra) a fully managed Cassandra compatible database service, is now is in scope for FedRAMP Moderate compliance to help you run highly regulated Cassandra workloads more easily. Federal Risk and Authorisation Management Program (FedRAMP) is a US government-wide program that delivers a standard approach to the security assessment, authorisation, and continuous monitoring for cloud products and services. Now, you can run Cassandra workloads that are subject to FedRAMP Moderate compliance more easily by using Amazon Keyspaces, a fully managed and serverless database service.\n\n#### **OpenZFS**\n\nAmazon FSx for OpenZFS now supports full-copy volumes to make it easier to clone and experiment with your data, enabling you to quickly capture the results of your cloning-based testing for long-term use.\n\n#### **Lustre**\n\nAmazon FSx for Lustre is now authorized as FedRAMP Moderate in US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon) and as FedRAMP High in AWS GovCloud (US-West) and AWS GovCloud (US-East). Amazon FSx for Lustre is also approved as Department of Defense Cloud Computing Security Requirements Guide Impact Level 2 (DoD SRG IL-2) in these regions.\n\n#### **MariaDB**\n\nAmazon RDS for MariaDB now supports MariaDB version 10.6. This release introduces multiple MariaDB features to enhance the performance, scalability, reliability and manageability of your workloads, including MyRocks storage engine, IAM integration, Flexible Upgrades, Delayed replication, Oracle PL/SQL compatibility, Atomic DDL and more. Read more details in the announcement, [Amazon RDS for MariaDB now supports MariaDB 10.6](https://aws-oss.beachgeek.co.uk/1bb)\n\n#### **Apache Kafka**\n\nAmazon Managed Streaming for Apache Kafka (Amazon MSK) now offers an option to provision storage throughput for Amazon MSK, enabling customers with high throughput workloads to seamlessly scale I/O without having to provision additional brokers. By provisioning up to 1000 MiB/s of throughput to Amazon MSK storage volumes, you can scale I/O requirements past 250 MiB/s without having to provision additional brokers. When configured, you pay a low rate for the amount of storage throughput provisioned in the clusters.\n\n#### **Videos of the week**\n**Visual Flow**\n\nVisual Flow, powered by Apache Spark, is a cloud-native open source ETL tool based on the Apache Spark unified analytics engine with a Graphical User Interface. Join Dmitri Pavlov as he shows you how to install this project on AWS.\n\n<video src=\"https://dev-media.amazoncloud.cn/d2e5ba88bc90495787f61831d947ed26_How%20to%20install%20Visual%20Flow%20%28open%20source%20ETL%20tool%29%20on%20AWS.mp4\" class=\"manvaVedio\" controls=\"controls\" style=\"width:160px;height:160px\"></video>\n\n#### **Rust on AWS**\n\nA must watch video this week comes from my colleague Gunnar Grosch, who is joined by Nicolas Moutschen for a look at using Rust on AWS!\n\n<video src=\"https://dev-media.amazoncloud.cn/647c2815210442b4b5534e370c84364a_AWS%20Nordics%20Office%20Hours%20-%20Using%20Rust%20on%20AWS.mp4\" class=\"manvaVedio\" controls=\"controls\" style=\"width:160px;height:160px\"></video>\n\n#### **Monokle**\n\nThis week, the Containers from the Couch team look at Monokle from Kubeshop for managing full lifecycle of your manifests. [Monokle](https://aws-oss.beachgeek.co.uk/1bn) is an open source project for creating, validating, debugging and managing manifests! 🚀\n\n<video src=\"https://dev-media.amazoncloud.cn/67de45e591374490ba170e2995d98c10_Kubernetes%20manifest%20management%20with%20Monokle.mp4\" class=\"manvaVedio\" controls=\"controls\" style=\"width:160px;height:160px\"></video>\n\n#### **Events for your diary**\nIf you have an event you want me to publish here, please contact me and I will include it in this listing.\n\n#### **Melbourne AWS Programming and Tools Meetup**\n#### **AWS Lambda Powertools for Python**\n#### **Wednesday, 9 February 9th, 6:00 pm AEDT**\n\nMichael Walmsley, a Serverless Architect from MyWizard AiOps at Accenture, will present a workshop introducing the AWS Lambda Powertools for Python. The workshop will cover the core utilities provided by the Powertools open source library and showcase the improved developer experience and cleaner code when using it to create your lambda projects!\n\nRead more and [sign up here](https://aws-oss.beachgeek.co.uk/1ba).\n\n#### **AWS HPC Speeds and Feeds**\n#### **February 9, 2022 | 8:30AM - 10:00AM PST**\n\nOver the past year, AWS HPC has introduced a host of new HPC products and services (many of them using open source technologies and project) to help today's scientists, engineers and researchers to run their workloads at scale for less cost and faster. Join us to hear directly from the engineers to learn more about the latest and greatest innovations from AWS HPC. To find out more about the talks, read the blog post [Join us for our HPC “Speeds n’ Feeds”](https://aws-oss.beachgeek.co.uk/1b0) to find out more, and use [this link to register](https://aws-oss.beachgeek.co.uk/1b1).\n\n#### **Cloud DevSecOps with Bridgecrew and Terraform**\n#### **Thursday, February 10th at 2pm GMT**\n\nFrom scanning infrastructure as code (IaC) for security misconfigurations to implementing automated DevSecOps workflows, this workshop will provide a hands-on experience to automate your cloud security.\n\nRead more and register, [AWS Dev Day Cloud DevSecOps with Bridgecrew and Terraform](https://aws-oss.beachgeek.co.uk/1ay)\n\n#### **HashiTalks 2022**\n#### **Thursday, Feb 17th**\n\nThe 24-hour HashiTalks is back for its fourth edition on Thursday, February 17. Tune-in to hear from and learn with fellow practitioners.\n\nFind your local chapter, find more details and [register here.](https://aws-oss.beachgeek.co.uk/1b3)\n\n#### **OpenSearch**\n#### **Every Tuesday, 3pm GMT**\n\nThis regular meet-up is for anyone interested in OpenSearch & Open Distro. All skill levels are welcome and they cover and welcome talks on topics including: search, logging, log analytics, and data visualisation.\n\nSign up to the next session, [OpenSearch Community Meeting - Feb2022](https://aws-oss.beachgeek.co.uk/1az)\n\n#### **GitOpsCon Europe**\n#### **May 17th, Valencia Spain**\n\nGitOpsCon Europe is designed to foster collaboration, discussion, and knowledge sharing on GitOps. This event is aimed at audiences that are new to GitOps as well as those currently using GitOps within their organisation. Get connected with others that are passionate about GitOps. Learn from practitioners about pitfalls to avoid, hurdles to jump, and how to adopt GitOps in your cloud native environment.\n\nThe event is vendor-neutral and is being organised by the CNCF GitOps Working Group. Topics include getting started with GitOps, scaling and managing GitOps, lessons learned from production deployments, technical sessions, and thought leadership.\n\nRead more about this from the official page [here](https://events.linuxfoundation.org/gitopscon-europe/).\n\n#### **CFP**\n#### **GitOpsCon**\n#### **CFP closes Feb, 14th**\n\nGitOpsCon Europe (#GitOpsCon) is designed to foster collaboration, discussion, and knowledge sharing on GitOps. This event is aimed at audiences that are new to GitOps as well as those currently using GitOps within their organization. Get connected with others that are passionate about GitOps. Learn from practitioners about pitfalls to avoid, hurdles to jump, and how to adopt GitOps in your cloud native environment.\n\nThe CFP is now open, and you can read more about, and [submit your own session here](https://aws-oss.beachgeek.co.uk/1b2).\n\n#### **Apache Airflow**\n#### **CFP closes March, 14th**\n\nA heads up to folks who are interested in all things Apache Airflow. Apache Airflow Summit 2022 has been announced and the call for papers (cfp) is now open. The bar for sessions is always very high, so looking forward to this event already.\n\nIf you have an idea for a talk, why not submit one via the cfp process. Check out the event, [Apache Airflow Summit 2022](https://aws-oss.beachgeek.co.uk/19e)\n\nIf you maybe have wanted to do a session, then I am very happy to help with feedback or coaching to help you feel more comfortable in creating and/or delivering your session. If this something that has been on your mind, but you just needed a little support, PLEASE get in touch.\n\n#### **Stay in touch with open source at AWS**\nI hope this summary has been useful. Remember to check out the [Open Source homepage](https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&opensource-all.sort-order=asc) to keep up to date with all our activity in open source by following us on [@AWSOpen](https://twitter.com/AWSOpen)","render":"<p>Newsletter #99. While Nena gave you 99 red balloons, I give you the latest version of the AWS open source news letter. This week we feature more great new open source projects including a project to help you with drift detection in your CloudFormation stacks, new Terraform modules, an open-source prometheus exporter, some AWS CDK resources and sample projects and more. This weeks AWS and Community posts cover PostgreSQL, Apache Airflow, AWS CDK, Redis, GraphQL, Apollo GraphQL, Kubernetes, AWS EKS and more. Make sure you check out the Quick Updates to stay on top of whats new in your favourite open source projects. In the videos, we feature Monokle, Rust, and a getting started with Visual Flow guide. Finally, we wrap up with Events, with a few happening later this week. As always, if you have an event/meet-up you want me to feature, just drop me a message and I will include it.</p>\n<h4><a id=\"Job_of_the_week_2\"></a><strong>Job of the week</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1b7\" target=\"_blank\">Principal Developer Advocate, Containers</a></p>\n<p>Amazon Web Services (AWS) is looking for a talented leader to lead the Bottlerocket and Amazon Linux Developer Advocacy program, part of Container services. Find out more, and apply via <a href=\"https://aws-oss.beachgeek.co.uk/1b7\" target=\"_blank\">this link</a>. If you want to have a chat about what it is like, feel free to drop me a mail.</p>\n<h4><a id=\"Celebrating_open_source_contributors_8\"></a><strong>Celebrating open source contributors</strong></h4>\n<p>The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.</p>\n<p>So thank you to the following open source heroes: Bhavani Ravi, Matthieu Napoli, Luc van Donkersgoed, Anouar Zaaber, Cem Altuner, Julien Grinsztajn, Amine El Mallem, Mohamed-Ali ELOUAER, Armando Segnini, Takahiro Ishii, HariKrishna Boorgadda, Rajesh Madiwale, Swanand Kshirsagar, Florian Chazal, Severin Gassauer-Fleissner, Zahi Ben Shabat, Nicolas Moutschen, Dmitri Pavlov, Gunnar Grosch and Zachariah Dzielinski.</p>\n<p>Make sure you find and follow these builders and keep up to date with their open source projects and contributions.</p>\n<h4><a id=\"Latest_open_source_projects_16\"></a><strong>Latest open source projects</strong></h4>\n<p><strong>Community</strong><br />\n<strong>bitesizedserverless</strong></p>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bv\" target=\"_blank\">bitesizedserverless</a> AWS Hero and Community Builder Luc van Donkersgoed has created a new repo to centralise all the various projects he has been working on. Worth a check to see if you might find something useful.</p>\n<h4><a id=\"cfndriftremediation_22\"></a><strong>cfn-drift-remediation</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bp\" target=\"_blank\">cfn-drift-remediation</a> Cloudar have created this tool that uses the Cloud Control API to remediate drift that was detected on a CloudFormation stack. If you want to remind yourself, <a href=\"https://aws-oss.beachgeek.co.uk/1bq\" target=\"_blank\">AWS Cloud Control API</a> a set of common application programming interfaces (APIs) that are designed to make it easy for developers to manage their AWS and third-party services.</p>\n<h4><a id=\"ssmprovisioner_26\"></a><strong>ssm-provisioner</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1br\" target=\"_blank\">ssm-provisioner</a> this tool from Zachariah Dzielinski provides the ability to provision AWS instances via SSM using Terraform. The project provides examples of how to get started and a short reason on why Zachariah created this project.</p>\n<h4><a id=\"corootawsagent_30\"></a><strong>coroot-aws-agent</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bs\" target=\"_blank\">coroot-aws-agent</a> is an open-source prometheus exporter that gathers metrics from AWS services.</p>\n<h4><a id=\"awsdefaultvpcdeleter_34\"></a><strong>aws-default-vpc-deleter</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bo\" target=\"_blank\">aws-default-vpc-deleter</a> if you are looking for a script to automate the deletion of an AWS VPC, then look no further as Cem Altuner has put together something that does exactly this. Use with caution of course, as it will delete stuff.</p>\n<h4><a id=\"Tools_38\"></a><strong>Tools</strong></h4>\n<h4><a id=\"TransactionChainsDataGenerator_39\"></a><strong>TransactionChainsDataGenerator</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bi\" target=\"_blank\">TransactionChainsDataGenerator</a> is a random data generation program to simulate a record of bank transactions between individuals. It first generates a configurable number of parties, some of which are marked as “suspicious”, and then a configurable number of transactions between them. Each transaction’s “originator party” and “beneficiary party” are selected entirely randomly from the pool, and the transaction amount is also random. The program outputs RDF files in Turtle syntax. To see how you can use this, check out the post from Severin Gassauer-Fleissner and Zahi Ben Shabat, <a href=\"https://aws-oss.beachgeek.co.uk/1bj\" target=\"_blank\">Financial Crime Discovery using Amazon EKS and Graph Databases</a></p>\n<p><img src=\"https://dev-media.amazoncloud.cn/542456c6af28450193a40faf613edc1c_image.png\" alt=\"image.png\" /></p>\n<h4><a id=\"singleec2cdk_45\"></a><strong>single-ec2-cdk</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bt\" target=\"_blank\">single-ec2-cdk</a> This is a simple CDK project that creates a single EC2 instance and copies a common set of tools needed for doing cloud development. This script handles the undifferentiated heavy lifting of creating a development environment, including a bunch of typical tools you might need. Make sure you read the doc, which covers some nice use cases I think this project is a good fit for.</p>\n<h4><a id=\"amazonemrwithdeltalake_49\"></a><strong>amazon-emr-with-delta-lake</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1c0\" target=\"_blank\">amazon-emr-with-delta-lake</a> this project contains code that show how to read from and write to Delta tables with Amazon EMR and help you quickly explore the main features of Delta Lake.</p>\n<h4><a id=\"awsappflowcustomconnectorpython_53\"></a><strong>aws-appflow-custom-connector-python</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bu\" target=\"_blank\">aws-appflow-custom-connector-python</a> Amazon AppFlow is a fully managed integration service that enables you to securely transfer data between Software-as-a-Service (SaaS) applications like Salesforce, SAP, Zendesk, Slack, and ServiceNow, and AWS services like Amazon S3 and Amazon Redshift. This project enables customers and third party developers to build custom source and/or destination connectors for the AppFlow service. If you are not a Python developer, but prefer Java, then you are in luck as you can use <a href=\"https://aws-oss.beachgeek.co.uk/1bz\" target=\"_blank\">aws-appflow-custom-connector-java.</a></p>\n<h4><a id=\"Demos_and_Samples_57\"></a><strong>Demos and Samples</strong></h4>\n<h4><a id=\"cdkamazonmwaacicd_58\"></a><strong>cdk-amazon-mwaa-cicd</strong></h4>\n<p><a href=\"https://aws-oss.beachgeek.co.uk/1bc\" target=\"_blank\">cdk-amazon-mwaa-cicd </a>a nice open sourced solution to automate the deployment and configuration of Managed Apache Airflow (MWAA) environments to programmatically author, schedule and monitor workflows. This repository demonstrates how one customer, ENGIE, were able to deploy a CI/CD pipeline for an Amazon MWAA project to automate the ingestion process from Salesforce using Airflow with an example. Anouar Zaaber, Julien Grinsztajn, Amine El Mallem, Mohamed-Ali ELOUAER, and Armando Segnini have collaborated in a detailed walkthrough blog post, <a href=\"https://aws-oss.beachgeek.co.uk/1bd\" target=\"_blank\">How ENGIE scales their data ingestion pipelines using Amazon MWAA</a></p>\n<p><img src=\"https://dev-media.amazoncloud.cn/09e7fd4020d84e31b7974ecd06cc2cd2_image.png\" alt=\"image.png\" /></p>\n<h4><a id=\"AWS_and_Community_blog_posts_64\"></a><strong>AWS and Community blog posts</strong></h4>\n<p><strong>Apache Airflow</strong></p>\n<p>In <a href=\"https://aws-oss.beachgeek.co.uk/1by\" target=\"_blank\">Merging Python Modules</a> Bhavani Ravi shares lessons learned in her quest to automate the task of merging multiple Python modules into a single one for Apache Airflow, and the solution she created. [hands on]</p>\n<h4><a id=\"Apollo_GraphQL_69\"></a><strong>Apollo GraphQL</strong></h4>\n<p>Apollo Federation is an architecture and specification used to build and connect multiple distributed backend GraphQL (micro)services, exposing a single endpoint and GraphQL schema to API clients and consumers. In <a href=\"https://aws-oss.beachgeek.co.uk/1bh\" target=\"_blank\">Apollo GraphQL Federation with AWS AppSync,</a> Florian Chazal explains how to setup an Apollo Federation Gateway connected to GraphQL subgraphs powered by AWS AppSync/ [hands on]</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/c16f9b7285cf4feaac8c01d1a0e972ae_image.png\" alt=\"image.png\" /></p>\n<h4><a id=\"PostgreSQL_75\"></a><strong>PostgreSQL</strong></h4>\n<p>In a two part post, HariKrishna Boorgadda, Rajesh Madiwale, and Swanand Kshirsagar discuss two ways to audit your PostgreSQL databases using the pgAudit extension. Check out the first post, <a href=\"https://aws-oss.beachgeek.co.uk/1bg\" target=\"_blank\">Part 1: Audit Aurora PostgreSQL databases using Database Activity Streams and pgAudit</a> and follow the link to part two in the article. [hands on]</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/daca98ed038642e3995a17e39208819d_image.png\" alt=\"image.png\" /></p>\n<h4><a id=\"Redis_81\"></a><strong>Redis</strong></h4>\n<p>Takahiro Ishii takes a look how Amazon MemoryDB for Redis is a great candidate for gaming leaderboard backends in the post, <a href=\"https://aws-oss.beachgeek.co.uk/1bf\" target=\"_blank\">Rethinking Game Leaderboards with Amazon MemoryDB for Redis</a></p>\n<h4><a id=\"Serverless_Framework_85\"></a><strong>Serverless Framework</strong></h4>\n<p>Matthieu Napoli provides a nice summary of what to expect with <a href=\"https://aws-oss.beachgeek.co.uk/1bx\" target=\"_blank\">Serverless v3</a> in his post, <a href=\"https://aws-oss.beachgeek.co.uk/1bw\" target=\"_blank\">Serverless Framework V3 Is Live!</a></p>\n<h4><a id=\"Other_posts_worth_checking_out_89\"></a><strong>Other posts worth checking out</strong></h4>\n<p>Last week, these posts also caught my eye.</p>\n<ul>\n<li><a href=\"https://aws-oss.beachgeek.co.uk/1c1\" target=\"_blank\">How to mount Linux volume and keep mount point consistency</a> explains how to mount Linux volumes and keep mount points preserved when the instance type is changed or the instance is rebooted.</li>\n<li><a href=\"https://aws-oss.beachgeek.co.uk/1bk\" target=\"_blank\">Continuous Delivery of Amazon EKS Clusters Using AWS CDK and CDK Pipelines</a> shows the use of AWS CDK and CDK Pipelines to deploy Amazon EKS clusters. [hands on]</li>\n</ul>\n<p><img src=\"https://dev-media.amazoncloud.cn/5c3440cfa02d430582a079af18228177_image.png\" alt=\"image.png\" /></p>\n<ul>\n<li><a href=\"https://aws-oss.beachgeek.co.uk/1be\" target=\"_blank\">Evolving REST APIs with GraphQL using AWS AppSync Direct Lambda Resolvers</a> learn how to use resources from an existing REST API built with AWS Serverless Application Model SAM, AWS API Gateaway, and AWS Lambda to work as AWS AppSync Direct Lambda Resolvers. [hands on]</li>\n<li><a href=\"https://aws-oss.beachgeek.co.uk/1bl\" target=\"_blank\">Use AWS Systems Manager custom Inventory to locate Log4j files on managed nodes</a> will show you how to use AWS System Manager’s custom inventory data type to locate Log4j JAR files on Windows and Amazon Linux EC2 instances and hybrid managed nodes. [hands on]</li>\n<li><a href=\"https://aws-oss.beachgeek.co.uk/1bm\" target=\"_blank\">Migrate SQL Server to Amazon Aurora PostgreSQL using best practices and lessons learned from the field</a> find out everything you need to successfully re-architect and migrate SQL Server to Aurora PostgreSQL.</li>\n</ul>\n<h4><a id=\"Quick_updates_102\"></a><strong>Quick updates</strong></h4>\n<p><strong>Apache Cassandra</strong></p>\n<p>Amazon Keyspaces (for Apache Cassandra) a fully managed Cassandra compatible database service, is now is in scope for FedRAMP Moderate compliance to help you run highly regulated Cassandra workloads more easily. Federal Risk and Authorisation Management Program (FedRAMP) is a US government-wide program that delivers a standard approach to the security assessment, authorisation, and continuous monitoring for cloud products and services. Now, you can run Cassandra workloads that are subject to FedRAMP Moderate compliance more easily by using Amazon Keyspaces, a fully managed and serverless database service.</p>\n<h4><a id=\"OpenZFS_107\"></a><strong>OpenZFS</strong></h4>\n<p>Amazon FSx for OpenZFS now supports full-copy volumes to make it easier to clone and experiment with your data, enabling you to quickly capture the results of your cloning-based testing for long-term use.</p>\n<h4><a id=\"Lustre_111\"></a><strong>Lustre</strong></h4>\n<p>Amazon FSx for Lustre is now authorized as FedRAMP Moderate in US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon) and as FedRAMP High in AWS GovCloud (US-West) and AWS GovCloud (US-East). Amazon FSx for Lustre is also approved as Department of Defense Cloud Computing Security Requirements Guide Impact Level 2 (DoD SRG IL-2) in these regions.</p>\n<h4><a id=\"MariaDB_115\"></a><strong>MariaDB</strong></h4>\n<p>Amazon RDS for MariaDB now supports MariaDB version 10.6. This release introduces multiple MariaDB features to enhance the performance, scalability, reliability and manageability of your workloads, including MyRocks storage engine, IAM integration, Flexible Upgrades, Delayed replication, Oracle PL/SQL compatibility, Atomic DDL and more. Read more details in the announcement, <a href=\"https://aws-oss.beachgeek.co.uk/1bb\" target=\"_blank\">Amazon RDS for MariaDB now supports MariaDB 10.6</a></p>\n<h4><a id=\"Apache_Kafka_119\"></a><strong>Apache Kafka</strong></h4>\n<p>Amazon Managed Streaming for Apache Kafka (Amazon MSK) now offers an option to provision storage throughput for Amazon MSK, enabling customers with high throughput workloads to seamlessly scale I/O without having to provision additional brokers. By provisioning up to 1000 MiB/s of throughput to Amazon MSK storage volumes, you can scale I/O requirements past 250 MiB/s without having to provision additional brokers. When configured, you pay a low rate for the amount of storage throughput provisioned in the clusters.</p>\n<h4><a id=\"Videos_of_the_week_123\"></a><strong>Videos of the week</strong></h4>\n<p><strong>Visual Flow</strong></p>\n<p>Visual Flow, powered by Apache Spark, is a cloud-native open source ETL tool based on the Apache Spark unified analytics engine with a Graphical User Interface. Join Dmitri Pavlov as he shows you how to install this project on AWS.</p>\n<p><video src=\"https://dev-media.amazoncloud.cn/d2e5ba88bc90495787f61831d947ed26_How%20to%20install%20Visual%20Flow%20%28open%20source%20ETL%20tool%29%20on%20AWS.mp4\" controls=\"controls\"></video></p>\n<h4><a id=\"Rust_on_AWS_130\"></a><strong>Rust on AWS</strong></h4>\n<p>A must watch video this week comes from my colleague Gunnar Grosch, who is joined by Nicolas Moutschen for a look at using Rust on AWS!</p>\n<p><video src=\"https://dev-media.amazoncloud.cn/647c2815210442b4b5534e370c84364a_AWS%20Nordics%20Office%20Hours%20-%20Using%20Rust%20on%20AWS.mp4\" controls=\"controls\"></video></p>\n<h4><a id=\"Monokle_136\"></a><strong>Monokle</strong></h4>\n<p>This week, the Containers from the Couch team look at Monokle from Kubeshop for managing full lifecycle of your manifests. <a href=\"https://aws-oss.beachgeek.co.uk/1bn\" target=\"_blank\">Monokle</a> is an open source project for creating, validating, debugging and managing manifests! 🚀</p>\n<p><video src=\"https://dev-media.amazoncloud.cn/67de45e591374490ba170e2995d98c10_Kubernetes%20manifest%20management%20with%20Monokle.mp4\" controls=\"controls\"></video></p>\n<h4><a id=\"Events_for_your_diary_142\"></a><strong>Events for your diary</strong></h4>\n<p>If you have an event you want me to publish here, please contact me and I will include it in this listing.</p>\n<h4><a id=\"Melbourne_AWS_Programming_and_Tools_Meetup_145\"></a><strong>Melbourne AWS Programming and Tools Meetup</strong></h4>\n<h4><a id=\"AWS_Lambda_Powertools_for_Python_146\"></a><strong>AWS Lambda Powertools for Python</strong></h4>\n<h4><a id=\"Wednesday_9_February_9th_600_pm_AEDT_147\"></a><strong>Wednesday, 9 February 9th, 6:00 pm AEDT</strong></h4>\n<p>Michael Walmsley, a Serverless Architect from MyWizard AiOps at Accenture, will present a workshop introducing the AWS Lambda Powertools for Python. The workshop will cover the core utilities provided by the Powertools open source library and showcase the improved developer experience and cleaner code when using it to create your lambda projects!</p>\n<p>Read more and <a href=\"https://aws-oss.beachgeek.co.uk/1ba\" target=\"_blank\">sign up here</a>.</p>\n<h4><a id=\"AWS_HPC_Speeds_and_Feeds_153\"></a><strong>AWS HPC Speeds and Feeds</strong></h4>\n<h4><a id=\"February_9_2022__830AM__1000AM_PST_154\"></a><strong>February 9, 2022 | 8:30AM - 10:00AM PST</strong></h4>\n<p>Over the past year, AWS HPC has introduced a host of new HPC products and services (many of them using open source technologies and project) to help today’s scientists, engineers and researchers to run their workloads at scale for less cost and faster. Join us to hear directly from the engineers to learn more about the latest and greatest innovations from AWS HPC. To find out more about the talks, read the blog post <a href=\"https://aws-oss.beachgeek.co.uk/1b0\" target=\"_blank\">Join us for our HPC “Speeds n’ Feeds”</a> to find out more, and use <a href=\"https://aws-oss.beachgeek.co.uk/1b1\" target=\"_blank\">this link to register</a>.</p>\n<h4><a id=\"Cloud_DevSecOps_with_Bridgecrew_and_Terraform_158\"></a><strong>Cloud DevSecOps with Bridgecrew and Terraform</strong></h4>\n<h4><a id=\"Thursday_February_10th_at_2pm_GMT_159\"></a><strong>Thursday, February 10th at 2pm GMT</strong></h4>\n<p>From scanning infrastructure as code (IaC) for security misconfigurations to implementing automated DevSecOps workflows, this workshop will provide a hands-on experience to automate your cloud security.</p>\n<p>Read more and register, <a href=\"https://aws-oss.beachgeek.co.uk/1ay\" target=\"_blank\">AWS Dev Day Cloud DevSecOps with Bridgecrew and Terraform</a></p>\n<h4><a id=\"HashiTalks_2022_165\"></a><strong>HashiTalks 2022</strong></h4>\n<h4><a id=\"Thursday_Feb_17th_166\"></a><strong>Thursday, Feb 17th</strong></h4>\n<p>The 24-hour HashiTalks is back for its fourth edition on Thursday, February 17. Tune-in to hear from and learn with fellow practitioners.</p>\n<p>Find your local chapter, find more details and <a href=\"https://aws-oss.beachgeek.co.uk/1b3\" target=\"_blank\">register here.</a></p>\n<h4><a id=\"OpenSearch_172\"></a><strong>OpenSearch</strong></h4>\n<h4><a id=\"Every_Tuesday_3pm_GMT_173\"></a><strong>Every Tuesday, 3pm GMT</strong></h4>\n<p>This regular meet-up is for anyone interested in OpenSearch &amp; Open Distro. All skill levels are welcome and they cover and welcome talks on topics including: search, logging, log analytics, and data visualisation.</p>\n<p>Sign up to the next session, <a href=\"https://aws-oss.beachgeek.co.uk/1az\" target=\"_blank\">OpenSearch Community Meeting - Feb2022</a></p>\n<h4><a id=\"GitOpsCon_Europe_179\"></a><strong>GitOpsCon Europe</strong></h4>\n<h4><a id=\"May_17th_Valencia_Spain_180\"></a><strong>May 17th, Valencia Spain</strong></h4>\n<p>GitOpsCon Europe is designed to foster collaboration, discussion, and knowledge sharing on GitOps. This event is aimed at audiences that are new to GitOps as well as those currently using GitOps within their organisation. Get connected with others that are passionate about GitOps. Learn from practitioners about pitfalls to avoid, hurdles to jump, and how to adopt GitOps in your cloud native environment.</p>\n<p>The event is vendor-neutral and is being organised by the CNCF GitOps Working Group. Topics include getting started with GitOps, scaling and managing GitOps, lessons learned from production deployments, technical sessions, and thought leadership.</p>\n<p>Read more about this from the official page <a href=\"https://events.linuxfoundation.org/gitopscon-europe/\" target=\"_blank\">here</a>.</p>\n<h4><a id=\"CFP_188\"></a><strong>CFP</strong></h4>\n<h4><a id=\"GitOpsCon_189\"></a><strong>GitOpsCon</strong></h4>\n<h4><a id=\"CFP_closes_Feb_14th_190\"></a><strong>CFP closes Feb, 14th</strong></h4>\n<p>GitOpsCon Europe (#GitOpsCon) is designed to foster collaboration, discussion, and knowledge sharing on GitOps. This event is aimed at audiences that are new to GitOps as well as those currently using GitOps within their organization. Get connected with others that are passionate about GitOps. Learn from practitioners about pitfalls to avoid, hurdles to jump, and how to adopt GitOps in your cloud native environment.</p>\n<p>The CFP is now open, and you can read more about, and <a href=\"https://aws-oss.beachgeek.co.uk/1b2\" target=\"_blank\">submit your own session here</a>.</p>\n<h4><a id=\"Apache_Airflow_196\"></a><strong>Apache Airflow</strong></h4>\n<h4><a id=\"CFP_closes_March_14th_197\"></a><strong>CFP closes March, 14th</strong></h4>\n<p>A heads up to folks who are interested in all things Apache Airflow. Apache Airflow Summit 2022 has been announced and the call for papers (cfp) is now open. The bar for sessions is always very high, so looking forward to this event already.</p>\n<p>If you have an idea for a talk, why not submit one via the cfp process. Check out the event, <a href=\"https://aws-oss.beachgeek.co.uk/19e\" target=\"_blank\">Apache Airflow Summit 2022</a></p>\n<p>If you maybe have wanted to do a session, then I am very happy to help with feedback or coaching to help you feel more comfortable in creating and/or delivering your session. If this something that has been on your mind, but you just needed a little support, PLEASE get in touch.</p>\n<h4><a id=\"Stay_in_touch_with_open_source_at_AWS_205\"></a><strong>Stay in touch with open source at AWS</strong></h4>\n<p>I hope this summary has been useful. Remember to check out the <a href=\"https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&amp;opensource-all.sort-order=asc\" target=\"_blank\">Open Source homepage</a> to keep up to date with all our activity in open source by following us on <a href=\"https://twitter.com/AWSOpen\" target=\"_blank\">@AWSOpen</a></p>\n"}