Open source news and updates #94

{"value":"#### **December 20th, 2021 - Instalment #94**\nNewsletter #94.\n\nThis will be the last newsletter of 2021 before I break for Christmas and New Year. I hope you have found this newsletter a useful resource for finding out about new or interesting open source projects, both from what Amazon Web Services contributes to, but also from the wider builder and open source developer communities.\n\nTo finish up for 2021 we have more new open source projects, covering Amazon Location Services, Amazon Web Services Fault Injection Simulator (FIS) experiment templates that are Amazon CDK ready, Media Replay Engine (MRE)a really nice project to help you automate the creation of replays, a transcribe, post call analytics solution and more. We also have some great content covering Apache Airflow, Apache Flink, Hugging Face, ROS, Apache HBase, Apache Spark, ActiveMQ, PyTorch, ROSA, Argo Rollouts, lots of Kubernetes related posts and more.\n\nFinally, make sure you check out the videos, where we have a really great story that combines Amazon Web Services DeepRacer with a rodent problem. Really cool stuff.\n\nTo start however, I just want to share some important updates about Apache Log4j.\n\n##### **Apache Log4j rce update**\n\nWe have been working very hard to help customers understand how to work through this incident. Here are some resources that you should check out, including a number of tools that you might find helpful.\n\n- ++[Hotpatch for Apache Log4j](https://aws-oss.beachgeek.co.uk/16g)++- this is a blog post published that provides some general information as well as access to some tooling that can help customers identify and patch systems that may be vulnerable. For customers who are using Amazon Linux 2, you can now install this quickly (++[https://twitter.com/stewartsmith/status/1471150310718468097](https://twitter.com/stewartsmith/status/1471150310718468097)++) via “yum install log4j-cve-2021-44228-hotpatch” as it has been added to the package repositories.\n- ++[Open source hotpatch for Apache Log4j vulnerability](https://aws-oss.beachgeek.co.uk/16l)++ - Amazon Web Services CISO Steve Schmidt summarised our efforts/position on this, pointing to the same resource above.\n- ++[hotpatch-for-apache-log4j2](https://aws-oss.beachgeek.co.uk/16m)++ - This is a tool which injects a Java agent into a running JVM process. The agent will attempt to patch the lookup() method of all loaded org.apache.logging.log4j.core.lookup.JndiLookup instances to unconditionally return the string \"Patched JndiLookup::lookup()\".\n\n- ++[kubernetes-log4j-cve-2021-44228-node-agent](https://aws-oss.beachgeek.co.uk/16n)++ - The Apache Log4j2 CVE-2021-44228 node agent is an open source project built by the Kubernetes team at Amazon Web Services. It is designed to run as a DaemonSet and mitigate the impact of Log4j2 CVE-2021-44228\n- ++[Using Amazon Web Services security services to protect against, detect, and respond to the Log4j vulnerability](https://aws-oss.beachgeek.co.uk/16j)++ - a guide on how to use Amazon Web Services security services to help you manage this incident.\n- ++[Advice on mitigating the Apache log4j security issue for EKS, ECS, and Fargate customers](https://aws-oss.beachgeek.co.uk/175)++- this post shows you how Amazon Elastic Container Service (Amazon ECS) and Amazon Elastic Kubernetes Service (Amazon EKS) customers using Amazon EC2 and Amazon Web Services Fargate to run their containerized applications can identify and mitigate CVE-2021-44228 and CVE-2021-45046 (the “log4j2 issue”).\n\n- ++[Container scanning updates in Amazon ECR private registries using Amazon Inspector](https://aws-oss.beachgeek.co.uk/176)++ - if you create/build/use container images, then check out how you can scan those to help identify vulnerabilities such as CVE-2021-44228 and CVE-2021-45046.\n\n##### **Job Alert**\n\nThis position is still open, and if you are looking for a fresh start to 2020 then read on. What are we looking for? We are looking for someone who will be responsible for defining, leading, and contributing to the open source and community engagement content strategy for the services and technology teams across Amazon Web Services. You will combine your passion and enthusiasm for cloud technology and open source with your unmatched creativity to generate content and support for Amazon Web Services among key open source communities, industry opinion makers, and technologists.\n\nYou will work closely with the product marketing leadership to translate the business priorities of the service teams into original content for a variety of audiences, including C-level, end users, developers, managers, and engineers.\n\nIdeally, you are already a recognisable figure in the open source ecosystem, in demand to contribute to technical and business publications, with an exemplary presence on social media.\n\nHere is the Job Spec, ++[Principal Evangelist, Open Source, Open Source Strategy & Marketing](https://aws-oss.beachgeek.co.uk/16e)++ where you can read more and see how to apply.\n\n#### **Celebrating open source contributors**\nThe articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.\n\nSo thank you to the following open source heroes: Rajarshi Das, Yasunori Kirimoto, Adam Cerin, Adrian Hornsby, John Gramila, Eira May, Ryan Donovan, Martin Paradesi, Vincent Gromakowski, Gary Stafford, Balasubramanian Sakthivel, Victor Gan, Manjula Nagineni, Amir Shenavandeh, Maryam Tavakoli, Laurence Miao, Srinivasa Shaik, Matt Aylward, Sasi Jayalekshmi, Suranjan Choudhury, Anil Sharma, Imaya Kumar Jagannathan, Michael Hausenblas, Bob Strahan, Andrew Kane, Connor Kirkpatrick, Franco Rezabek, and Steve Engledow.\n\nMake sure you find and follow these builders and keep up to date with their open source projects and contributions.\n\n#### **Latest open source projects**\n##### **amazon-location-service-starter**\n\n++[amazon-location-service-starter](https://aws-oss.beachgeek.co.uk/17e)++ this is a starter open source project from Yasunori Kirimoto that gets you started with Amazon Location Service using a number of Amazon Web Services Services and open source projects - Amazon Web Services Amplify, MapLibre GL JS Amplify, MapLibre GL JS, webpack.\n\n\n\n##### **Amazon Web Services-media-replay-engine**\n\n++[Amazon Web Services-media-replay-engine](https://aws-oss.beachgeek.co.uk/17f)++ this Apache 2.0 project, Media Replay Engine (MRE) is a framework to build automated video clipping and replay (highlight) generation pipelines for live and video-on-demand content. Nice detailed docs, including some guidelines on costs, make sure you check out this project.\n\n\n\n##### **Amazon Web Services-fis-templates-cdk**\n\n++[Amazon Web Services-fis-templates-cdk](https://aws-oss.beachgeek.co.uk/17g)++ chatting last week with Adrian Hornsby before he spends some time in the artic circle, he shared with me this repo that contains a collection of Amazon Web Services Fault Injection Simulator (FIS) experiment templates deploy-able via with the Amazon Web Services CDK. These templates let you perform fault injection experiments on resources (applications, network, and infrastructure) in the Amazon Web Services Cloud.\n\n##### **Amazon Web Services-securityhub-falco-ecs-eks-integration**\n\n++[Amazon Web Services-securityhub-falco-ecs-eks-integration](https://aws-oss.beachgeek.co.uk/179)++ this repo deploys a Lambda function, that enables generating Falco findings into Security Hub. To walk you through this, Rajarshi Das and Adam Cerin have put together this post, ++[Continuous runtime security monitoring with Amazon Security Hub and Falco](https://aws-oss.beachgeek.co.uk/17a)++\n\n\n\n##### **amazon-transcribe-post-call-analytics**\n\n++[amazon-transcribe-post-call-analytics](https://aws-oss.beachgeek.co.uk/17b)++ This open source sample solution, Post Call Analytics (PCA), does most of the heavy lifting associated with providing an end-to-end solution that can process call recordings from your existing contact center. Bob Strahan, Andrew Kane, Connor Kirkpatrick, Franco Rezabek, and Steve Engledow have collaborated on this post, ++[Post call analytics for your contact center with Amazon language AI services](https://aws-oss.beachgeek.co.uk/17c)++ to help you get started.\n\n\n\n##### **poro**\n\n++[poro](https://aws-oss.beachgeek.co.uk/174)++ this script lets you scan publicly accessible assets on your Amazon Web Services cloud environment for reporting. purposes. Might come in handy for folks that are looking to do this.\n\n#### **Amazon Web Services and Community blog posts**\n##### **Amazon Web Services BugBust**\n\nEarlier in the year, we announced BugBust - a worldwide competition to help find and fix bugs in Java and Python applications. During re:Invent, there was an attempt to set a Guinness World Record for the largest bug fixing challenge. I don't want to spoil the surprise, so check out this write up from Eira May and Ryan Donovan, ++[Smashing bugs to set a world record: Amazon Web Services BugBust](https://aws-oss.beachgeek.co.uk/173)++\n\n##### **Amazon EMR**\n\nWhen it comes to saving money, I am all ears. I therefore was very thankful to John Gramila for putting together, ++[Amazon Web Services EMR Cost Optimization Guide](https://aws-oss.beachgeek.co.uk/172)++. If you are using or planning to use Amazon EMR, then make sure you check out some of the tips in this post to help you optimise your costs.\n\n##### **ROS**\n\nCamilo Buscaron shares news that we have added the supporting software and simulation artefacts to integrate the Amazon Web Services DeepRacer Evo 64 device software with ROS Nav2 stack, and made it available to the open source community via the Amazon Web Services DeepRacer GitHub in his post, ++[Integrating ROS Nav2 stack with Amazon DeepRacer](https://aws-oss.beachgeek.co.uk/171)++\n\t\n\n\n##### **Grafana**\n\nIn case you missed it, there were a number of nice announcements during pre:Invent and re:Invent for customers who are interested in Grafana. Imaya Kumar Jagannathan and Michael Hausenblas have summarised these in the post, Amazon Athena, ++[Amazon Redshift Plugins and New Features in Amazon Managed Grafana](https://aws-oss.beachgeek.co.uk/170)++ walking you through the Geomap visualisation, Amazon Redshift data source, CloudWatch Metrics Insights, and interestingly, IoT TwinMaker integration (which is in preview). Lots to digest, so make sure you check this out.\n\n\n\n##### **Apache Airflow**\n\nA couple of posts you should check out this week.\n\nFirst up, we have Gary Stafford who writes, ++[DevOps for DataOps: Building a CI/CD Pipeline for Apache Airflow DAGs](https://aws-oss.beachgeek.co.uk/16o)++ showing you how you can use GitHub Actions to build an effective CI/CD workflow for our Apache Airflow DAGs.\n\n\n\nFollowing that we have a short post from myself, ++[Setting up MWAA to use a KMS key](https://aws-oss.beachgeek.co.uk/16p)++ where I walk you through how to configure your Managed Workflows for Apache Airflow to use a customer defined KMS key so that you can encrypt everything within your Airflow environment.\n\n##### **Apache Flink**\n\nIn this post ++[How Goldman Sachs built persona tagging using Apache Flink on Amazon EMR](https://aws-oss.beachgeek.co.uk/16k)++, Balasubramanian Sakthivel, Victor Gan, and Manjula Nagineni share with you how Goldman Sachs built a system using Apache Flink on Amazon EMR to carry out the tagging of users with various personas, in order to better curate content offerings for those users.\n\n\n\n##### **Apache Spark**\n\nVincent Gromakowski shares ++[Best practices for running Spark on Amazon EKS](https://aws-oss.beachgeek.co.uk/16q)++ where you will learn how to configure Apache Spark and Amazon EKS to support common requirements, including resources isolation, cost reduction, dynamic scaling, performance optimisation, and fine-grained access control.\n\n##### **Apache HBase**\n\nApache HBase is a popular, open source non-relational database. One of the typical use cases where you find it being used, is when you need random, realtime read/write access to your Big Data - the project's goal is the hosting of very large tables, billions of rows X millions of columns. In this post, ++[Stream Apache HBase edits for real-time analytics](https://aws-oss.beachgeek.co.uk/16r)++ Amir Shenavandeh and Maryam Tavakoli walk you through Apache HBase scaling and replication concepts before sharing some common use cases and solutions, along with some best practices when implementing your custom HBase streaming replication endpoints.\n\n\n\n##### **PyTorch**\n\nLaurence Miao shares how to ++[Build GAN with PyTorch and Amazon SageMaker](https://aws-oss.beachgeek.co.uk/16t)++, and he walks you through building your first GAN model using Amazon SageMaker, learning GANs from the perspective of practical engineering experiences, as well as opening a new AI/ML domain of generative models. The post also introduces a use case of one of the hottest GAN applications in the synthetic data generation area. [hands on]\n\n\n\nFor more PyTorch content, check out the links below for \"Build custom Amazon SageMaker PyTorch models for real-time handwriting text recognition\"\n\n##### **Argo Rollouts**\n\nArgo Rollouts is a Kubernetes controller and set of CRDs which provide advanced deployment capabilities such as blue-green, canary, canary analysis, experimentation, and progressive delivery features to Kubernetes. Srinivasa Shaik, Matt Aylward, and Sasi Jayalekshmi have collaborated on the post, ++[Use Amazon EKS and Argo Rollouts for Progressive Delivery](https://aws-oss.beachgeek.co.uk/16u)++ showing you how when you implement a progressive delivery controller (via Argo Rollouts) in conjunction with Amazon services, you can tune the speed of your deployments and measure your success with KPIs.\n\n\n\n##### **ActiveMQ**\n\nSuranjan Choudhury and Anil Sharma have come together to write ++[Using an Amazon MQ network of broker topologies for distributed microservices](https://aws-oss.beachgeek.co.uk/16x)++ where they look at ActiveMQ topologies that customers can evaluate when planning hybrid deployment architectures spanning Amazon Web Services Regions and customer data centers, using a network of brokers.\n\n\n\n##### **Other posts worth checking out**\n\n- ++[Achieve 35% faster training with Hugging Face Deep Learning Containers on Amazon SageMaker](https://aws-oss.beachgeek.co.uk/16j)++ shows you how to pretrain an NLP model (ALBERT) on Amazon SageMaker by using Hugging Face Deep Learning Container (DLC) and transformers library.\n- ++[Build custom Amazon SageMaker PyTorch models for real-time handwriting text recognition](https://aws-oss.beachgeek.co.uk/16z)++ shares the processes, scripts, and best practices to develop a custom ML model in Amazon SageMaker that applies deep learning (DL) techniques based on the concept outlined in the paper \"GNHK: A Dataset for English Handwriting in the Wild\" to transcribe text in images of handwritten passages into strings\n\n- ++[Automate Container Anomaly Monitoring of Amazon Elastic Kubernetes Service Clusters with Amazon DevOps Guru](https://aws-oss.beachgeek.co.uk/16s)++ read on to find out about new features in Amazon DevOps Guru to help simplify and expand the capabilities of the operator to address some of the challenges due to the increasing number of abstractions and supporting infrastructure when implementing observability.\n\n- ++[Proactive autoscaling of Kubernetes workloads with KEDA using metrics ingested into Amazon Managed Service for Prometheus](https://aws-oss.beachgeek.co.uk/17d)++ shows you how you can use Kubernetes based Event Driven Autoscaler (KEDA) to autoscale Amazon EKS Pods by querying the metrics stored in Amazon Managed Service for Prometheus\n- ++[Implementing custom domain names with ROSA](https://aws-oss.beachgeek.co.uk/16v)++ explains how to register a domain using Amazon Web Services registered domains, create a Route 53 hosted zone, and configure the Red Hat OpenShift Service on Amazon to make use of that custom domain.\n\n- ++[Replicate your data from Amazon Aurora MySQL to Amazon ElastiCache for Redis using Amazon DMS](https://aws-oss.beachgeek.co.uk/16w)++ explores use cases and best practices when migrating data to an ElastiCache for Redis cluster.\n- ++[How to fix SSH issues on EC2 Linux instances using Amazon Web Services Systems Manager](https://aws-oss.beachgeek.co.uk/177)++ shows you how you can use a feature of Amazon Web Services Systems Manager to tackle unreachable Linux instances, and fix common issues, such as OpenSSH file permissions, or gather system (OS) logs for analysis and troubleshooting\n- ++[Cost savings by customizing metrics sent by Container Insights in Amazon EKS](https://aws-oss.beachgeek.co.uk/178)++ is a post that shares how to configure the ADOT Collector for an Amazon EKS cluster\n\n##### **Quick updates**\n###### **Spring Boot**\n\n++[v2.3.3](https://aws-oss.beachgeek.co.uk/16y)++ is now available, and this version bumps a spring-messaging dependency to 5.3.13. Previous Spring Cloud Amazon Web Services versions relied on spring-messaging that suffered from a security vulnerability (#206). If you relied on Spring Cloud Amazon Web Services to determine spring-messaging version, please update to Spring Cloud Amazon Web Services 2.3.3. Other changes include:\n\n- Fix: context order when loading properties (Parameter Store and Secrets Manager) - @WtfJoke\n- Docs: Mention no Aurora support in RDS docs (RDS) - @aravindparappil46\n- Dependency Upgrade: Upgrade Maven Wrapper - ++[@tinexw](https://dev.to/tinexw)++\n- Enhancement: Log exception on message processing failure (SQS) - @ebussieres\n- Dependency Upgrade: Upgrade Spring Cloud Build to 3.0.5 - ++[@maciejwalkowiak](https://dev.to/maciejwalkowiak)++\n- Dependency Upgrade: Upgrade Amazon Web Services SDK to 1.12.129 - ++[@maciejwalkowiak](https://dev.to/maciejwalkowiak)++\n\n##### **Videos of the week**\n###### **RoboCat**\n\nLoved this video, and now have ideas of how I can use my DeepRacer to do something similar. Searching for a humane way to scare mice out of his kitchen, Martin Paradesi modified an autonomous DeepRacer model car, and its open source code, to come up with a RoboCat that could scare mice away in the dark. Find out how his young sons contributed to the project.\n\n<video src=\"https://dev-media.amazoncloud.cn/8ac5da9fb2234f3d933a3d095368cdeb_AWS%20Innovators%20-%20S1E6%EF%BC%9A%20Martin%20%EF%BD%9C%20Amazon%20Web%20Services.mp4\" class=\"manvaVedio\" controls=\"controls\" style=\"width:160px;height:160px\"></video>\n\n##### **Events for your diary**\nWatch this space for events in 2022. If you have an event you want me to publish here, please contact me and I will include it in this listing.\n\n##### **Stay in touch with open source at Amazon Web Services**\nI hope this summary has been useful. Remember to check out the ++[Open Source homepage](https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&opensource-all.sort-order=asc)++ to keep up to date with all our activity in open source by following us on ++[@Amazon Web ServicesOpen](https://twitter.com/AWSOpen)++\n\n\n\n\n\n\n\n\n\n","render":"<h4><a id=\"December_20th_2021__Instalment_94_0\"></a><strong>December 20th, 2021 - Instalment #94</strong></h4>\n<p>Newsletter #94.</p>\n<p>This will be the last newsletter of 2021 before I break for Christmas and New Year. I hope you have found this newsletter a useful resource for finding out about new or interesting open source projects, both from what Amazon Web Services contributes to, but also from the wider builder and open source developer communities.</p>\n<p>To finish up for 2021 we have more new open source projects, covering Amazon Location Services, Amazon Web Services Fault Injection Simulator (FIS) experiment templates that are Amazon CDK ready, Media Replay Engine (MRE)a really nice project to help you automate the creation of replays, a transcribe, post call analytics solution and more. We also have some great content covering Apache Airflow, Apache Flink, Hugging Face, ROS, Apache HBase, Apache Spark, ActiveMQ, PyTorch, ROSA, Argo Rollouts, lots of Kubernetes related posts and more.</p>\n<p>Finally, make sure you check out the videos, where we have a really great story that combines Amazon Web Services DeepRacer with a rodent problem. Really cool stuff.</p>\n<p>To start however, I just want to share some important updates about Apache Log4j.</p>\n<h5><a id=\"Apache_Log4j_rce_update_11\"></a><strong>Apache Log4j rce update</strong></h5>\n<p>We have been working very hard to help customers understand how to work through this incident. Here are some resources that you should check out, including a number of tools that you might find helpful.</p>\n<ul>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16g\" target=\"_blank\">Hotpatch for Apache Log4j</a></ins>- this is a blog post published that provides some general information as well as access to some tooling that can help customers identify and patch systems that may be vulnerable. For customers who are using Amazon Linux 2, you can now install this quickly (<ins><a href=\"https://twitter.com/stewartsmith/status/1471150310718468097\" target=\"_blank\">https://twitter.com/stewartsmith/status/1471150310718468097</a></ins>) via “yum install log4j-cve-2021-44228-hotpatch” as it has been added to the package repositories.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16l\" target=\"_blank\">Open source hotpatch for Apache Log4j vulnerability</a></ins> - Amazon Web Services CISO Steve Schmidt summarised our efforts/position on this, pointing to the same resource above.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16m\" target=\"_blank\">hotpatch-for-apache-log4j2</a></ins> - This is a tool which injects a Java agent into a running JVM process. The agent will attempt to patch the lookup() method of all loaded org.apache.logging.log4j.core.lookup.JndiLookup instances to unconditionally return the string “Patched JndiLookup::lookup()”.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16n\" target=\"_blank\">kubernetes-log4j-cve-2021-44228-node-agent</a></ins> - The Apache Log4j2 CVE-2021-44228 node agent is an open source project built by the Kubernetes team at Amazon Web Services. It is designed to run as a DaemonSet and mitigate the impact of Log4j2 CVE-2021-44228</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16j\" target=\"_blank\">Using Amazon Web Services security services to protect against, detect, and respond to the Log4j vulnerability</a></ins> - a guide on how to use Amazon Web Services security services to help you manage this incident.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/175\" target=\"_blank\">Advice on mitigating the Apache log4j security issue for EKS, ECS, and Fargate customers</a></ins>- this post shows you how Amazon Elastic Container Service (Amazon ECS) and Amazon Elastic Kubernetes Service (Amazon EKS) customers using Amazon EC2 and Amazon Web Services Fargate to run their containerized applications can identify and mitigate CVE-2021-44228 and CVE-2021-45046 (the “log4j2 issue”).</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/176\" target=\"_blank\">Container scanning updates in Amazon ECR private registries using Amazon Inspector</a></ins> - if you create/build/use container images, then check out how you can scan those to help identify vulnerabilities such as CVE-2021-44228 and CVE-2021-45046.</p>\n</li>\n</ul>\n<h5><a id=\"Job_Alert_25\"></a><strong>Job Alert</strong></h5>\n<p>This position is still open, and if you are looking for a fresh start to 2020 then read on. What are we looking for? We are looking for someone who will be responsible for defining, leading, and contributing to the open source and community engagement content strategy for the services and technology teams across Amazon Web Services. You will combine your passion and enthusiasm for cloud technology and open source with your unmatched creativity to generate content and support for Amazon Web Services among key open source communities, industry opinion makers, and technologists.</p>\n<p>You will work closely with the product marketing leadership to translate the business priorities of the service teams into original content for a variety of audiences, including C-level, end users, developers, managers, and engineers.</p>\n<p>Ideally, you are already a recognisable figure in the open source ecosystem, in demand to contribute to technical and business publications, with an exemplary presence on social media.</p>\n<p>Here is the Job Spec, <ins><a href=\"https://aws-oss.beachgeek.co.uk/16e\" target=\"_blank\">Principal Evangelist, Open Source, Open Source Strategy &amp; Marketing</a></ins> where you can read more and see how to apply.</p>\n<h4><a id=\"Celebrating_open_source_contributors_35\"></a><strong>Celebrating open source contributors</strong></h4>\n<p>The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.</p>\n<p>So thank you to the following open source heroes: Rajarshi Das, Yasunori Kirimoto, Adam Cerin, Adrian Hornsby, John Gramila, Eira May, Ryan Donovan, Martin Paradesi, Vincent Gromakowski, Gary Stafford, Balasubramanian Sakthivel, Victor Gan, Manjula Nagineni, Amir Shenavandeh, Maryam Tavakoli, Laurence Miao, Srinivasa Shaik, Matt Aylward, Sasi Jayalekshmi, Suranjan Choudhury, Anil Sharma, Imaya Kumar Jagannathan, Michael Hausenblas, Bob Strahan, Andrew Kane, Connor Kirkpatrick, Franco Rezabek, and Steve Engledow.</p>\n<p>Make sure you find and follow these builders and keep up to date with their open source projects and contributions.</p>\n<h4><a id=\"Latest_open_source_projects_42\"></a><strong>Latest open source projects</strong></h4>\n<h5><a id=\"amazonlocationservicestarter_43\"></a><strong>amazon-location-service-starter</strong></h5>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/17e\" target=\"_blank\">amazon-location-service-starter</a></ins> this is a starter open source project from Yasunori Kirimoto that gets you started with Amazon Location Service using a number of Amazon Web Services Services and open source projects - Amazon Web Services Amplify, MapLibre GL JS Amplify, MapLibre GL JS, webpack.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/07af194a5cc44e05bc6754c03949ac35_README01.gif\" alt=\"README01.gif\" /></p>\n<h5><a id=\"Amazon_Web_Servicesmediareplayengine_49\"></a><strong>Amazon Web Services-media-replay-engine</strong></h5>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/17f\" target=\"_blank\">Amazon Web Services-media-replay-engine</a></ins> this Apache 2.0 project, Media Replay Engine (MRE) is a framework to build automated video clipping and replay (highlight) generation pipelines for live and video-on-demand content. Nice detailed docs, including some guidelines on costs, make sure you check out this project.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/8aafb90bde22470ab5998bdf0d9626da_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"Amazon_Web_Servicesfistemplatescdk_55\"></a><strong>Amazon Web Services-fis-templates-cdk</strong></h5>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/17g\" target=\"_blank\">Amazon Web Services-fis-templates-cdk</a></ins> chatting last week with Adrian Hornsby before he spends some time in the artic circle, he shared with me this repo that contains a collection of Amazon Web Services Fault Injection Simulator (FIS) experiment templates deploy-able via with the Amazon Web Services CDK. These templates let you perform fault injection experiments on resources (applications, network, and infrastructure) in the Amazon Web Services Cloud.</p>\n<h5><a id=\"Amazon_Web_Servicessecurityhubfalcoecseksintegration_59\"></a><strong>Amazon Web Services-securityhub-falco-ecs-eks-integration</strong></h5>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/179\" target=\"_blank\">Amazon Web Services-securityhub-falco-ecs-eks-integration</a></ins> this repo deploys a Lambda function, that enables generating Falco findings into Security Hub. To walk you through this, Rajarshi Das and Adam Cerin have put together this post, <ins><a href=\"https://aws-oss.beachgeek.co.uk/17a\" target=\"_blank\">Continuous runtime security monitoring with Amazon Security Hub and Falco</a></ins></p>\n<p><img src=\"https://dev-media.amazoncloud.cn/8516e17066ab411e872482f5f6eb0cd3_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"amazontranscribepostcallanalytics_65\"></a><strong>amazon-transcribe-post-call-analytics</strong></h5>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/17b\" target=\"_blank\">amazon-transcribe-post-call-analytics</a></ins> This open source sample solution, Post Call Analytics (PCA), does most of the heavy lifting associated with providing an end-to-end solution that can process call recordings from your existing contact center. Bob Strahan, Andrew Kane, Connor Kirkpatrick, Franco Rezabek, and Steve Engledow have collaborated on this post, <ins><a href=\"https://aws-oss.beachgeek.co.uk/17c\" target=\"_blank\">Post call analytics for your contact center with Amazon language AI services</a></ins> to help you get started.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/597d8a213c31427b84a56dce6b34dc5b_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"poro_71\"></a><strong>poro</strong></h5>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/174\" target=\"_blank\">poro</a></ins> this script lets you scan publicly accessible assets on your Amazon Web Services cloud environment for reporting. purposes. Might come in handy for folks that are looking to do this.</p>\n<h4><a id=\"Amazon_Web_Services_and_Community_blog_posts_75\"></a><strong>Amazon Web Services and Community blog posts</strong></h4>\n<h5><a id=\"Amazon_Web_Services_BugBust_76\"></a><strong>Amazon Web Services BugBust</strong></h5>\n<p>Earlier in the year, we announced BugBust - a worldwide competition to help find and fix bugs in Java and Python applications. During re:Invent, there was an attempt to set a Guinness World Record for the largest bug fixing challenge. I don’t want to spoil the surprise, so check out this write up from Eira May and Ryan Donovan, <ins><a href=\"https://aws-oss.beachgeek.co.uk/173\" target=\"_blank\">Smashing bugs to set a world record: Amazon Web Services BugBust</a></ins></p>\n<h5><a id=\"Amazon_EMR_80\"></a><strong>Amazon EMR</strong></h5>\n<p>When it comes to saving money, I am all ears. I therefore was very thankful to John Gramila for putting together, <ins><a href=\"https://aws-oss.beachgeek.co.uk/172\" target=\"_blank\">Amazon Web Services EMR Cost Optimization Guide</a></ins>. If you are using or planning to use Amazon EMR, then make sure you check out some of the tips in this post to help you optimise your costs.</p>\n<h5><a id=\"ROS_84\"></a><strong>ROS</strong></h5>\n<p>Camilo Buscaron shares news that we have added the supporting software and simulation artefacts to integrate the Amazon Web Services DeepRacer Evo 64 device software with ROS Nav2 stack, and made it available to the open source community via the Amazon Web Services DeepRacer GitHub in his post, <ins><a href=\"https://aws-oss.beachgeek.co.uk/171\" target=\"_blank\">Integrating ROS Nav2 stack with Amazon DeepRacer</a></ins></p>\n<p><img src=\"https://dev-media.amazoncloud.cn/0969b80fb8d44f6c9be7a5e56098c6e6_8cc365fd7820546e100662dda1da851c2af7234b.gif\" alt=\"8cc365fd7820546e100662dda1da851c2af7234b.gif\" /></p>\n<h5><a id=\"Grafana_90\"></a><strong>Grafana</strong></h5>\n<p>In case you missed it, there were a number of nice announcements during pre:Invent and re:Invent for customers who are interested in Grafana. Imaya Kumar Jagannathan and Michael Hausenblas have summarised these in the post, Amazon Athena, <ins><a href=\"https://aws-oss.beachgeek.co.uk/170\" target=\"_blank\">Amazon Redshift Plugins and New Features in Amazon Managed Grafana</a></ins> walking you through the Geomap visualisation, Amazon Redshift data source, CloudWatch Metrics Insights, and interestingly, IoT TwinMaker integration (which is in preview). Lots to digest, so make sure you check this out.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/db41fdf2914e4a68b9fa7b210e3eb323_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"Apache_Airflow_96\"></a><strong>Apache Airflow</strong></h5>\n<p>A couple of posts you should check out this week.</p>\n<p>First up, we have Gary Stafford who writes, <ins><a href=\"https://aws-oss.beachgeek.co.uk/16o\" target=\"_blank\">DevOps for DataOps: Building a CI/CD Pipeline for Apache Airflow DAGs</a></ins> showing you how you can use GitHub Actions to build an effective CI/CD workflow for our Apache Airflow DAGs.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/acdf4e793435419cb1c70215f2f4a10b_image.png\" alt=\"image.png\" /></p>\n<p>Following that we have a short post from myself, <ins><a href=\"https://aws-oss.beachgeek.co.uk/16p\" target=\"_blank\">Setting up MWAA to use a KMS key</a></ins> where I walk you through how to configure your Managed Workflows for Apache Airflow to use a customer defined KMS key so that you can encrypt everything within your Airflow environment.</p>\n<h5><a id=\"Apache_Flink_106\"></a><strong>Apache Flink</strong></h5>\n<p>In this post <ins><a href=\"https://aws-oss.beachgeek.co.uk/16k\" target=\"_blank\">How Goldman Sachs built persona tagging using Apache Flink on Amazon EMR</a></ins>, Balasubramanian Sakthivel, Victor Gan, and Manjula Nagineni share with you how Goldman Sachs built a system using Apache Flink on Amazon EMR to carry out the tagging of users with various personas, in order to better curate content offerings for those users.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/e10e15f751f64a2882757356996d7c8e_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"Apache_Spark_112\"></a><strong>Apache Spark</strong></h5>\n<p>Vincent Gromakowski shares <ins><a href=\"https://aws-oss.beachgeek.co.uk/16q\" target=\"_blank\">Best practices for running Spark on Amazon EKS</a></ins> where you will learn how to configure Apache Spark and Amazon EKS to support common requirements, including resources isolation, cost reduction, dynamic scaling, performance optimisation, and fine-grained access control.</p>\n<h5><a id=\"Apache_HBase_116\"></a><strong>Apache HBase</strong></h5>\n<p>Apache HBase is a popular, open source non-relational database. One of the typical use cases where you find it being used, is when you need random, realtime read/write access to your Big Data - the project’s goal is the hosting of very large tables, billions of rows X millions of columns. In this post, <ins><a href=\"https://aws-oss.beachgeek.co.uk/16r\" target=\"_blank\">Stream Apache HBase edits for real-time analytics</a></ins> Amir Shenavandeh and Maryam Tavakoli walk you through Apache HBase scaling and replication concepts before sharing some common use cases and solutions, along with some best practices when implementing your custom HBase streaming replication endpoints.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/32d8fd9cbaf4403ba2e01dc7ab7c5716_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"PyTorch_122\"></a><strong>PyTorch</strong></h5>\n<p>Laurence Miao shares how to <ins><a href=\"https://aws-oss.beachgeek.co.uk/16t\" target=\"_blank\">Build GAN with PyTorch and Amazon SageMaker</a></ins>, and he walks you through building your first GAN model using Amazon SageMaker, learning GANs from the perspective of practical engineering experiences, as well as opening a new AI/ML domain of generative models. The post also introduces a use case of one of the hottest GAN applications in the synthetic data generation area. [hands on]</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/ebe86ef804374988b217420c9b686b51_image.png\" alt=\"image.png\" /></p>\n<p>For more PyTorch content, check out the links below for “Build custom Amazon SageMaker PyTorch models for real-time handwriting text recognition”</p>\n<h5><a id=\"Argo_Rollouts_130\"></a><strong>Argo Rollouts</strong></h5>\n<p>Argo Rollouts is a Kubernetes controller and set of CRDs which provide advanced deployment capabilities such as blue-green, canary, canary analysis, experimentation, and progressive delivery features to Kubernetes. Srinivasa Shaik, Matt Aylward, and Sasi Jayalekshmi have collaborated on the post, <ins><a href=\"https://aws-oss.beachgeek.co.uk/16u\" target=\"_blank\">Use Amazon EKS and Argo Rollouts for Progressive Delivery</a></ins> showing you how when you implement a progressive delivery controller (via Argo Rollouts) in conjunction with Amazon services, you can tune the speed of your deployments and measure your success with KPIs.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/29958803914a4d93a43151634195fa5a_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"ActiveMQ_136\"></a><strong>ActiveMQ</strong></h5>\n<p>Suranjan Choudhury and Anil Sharma have come together to write <ins><a href=\"https://aws-oss.beachgeek.co.uk/16x\" target=\"_blank\">Using an Amazon MQ network of broker topologies for distributed microservices</a></ins> where they look at ActiveMQ topologies that customers can evaluate when planning hybrid deployment architectures spanning Amazon Web Services Regions and customer data centers, using a network of brokers.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/f79bf95645214454a2e8d578936e908e_image.png\" alt=\"image.png\" /></p>\n<h5><a id=\"Other_posts_worth_checking_out_142\"></a><strong>Other posts worth checking out</strong></h5>\n<ul>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16j\" target=\"_blank\">Achieve 35% faster training with Hugging Face Deep Learning Containers on Amazon SageMaker</a></ins> shows you how to pretrain an NLP model (ALBERT) on Amazon SageMaker by using Hugging Face Deep Learning Container (DLC) and transformers library.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16z\" target=\"_blank\">Build custom Amazon SageMaker PyTorch models for real-time handwriting text recognition</a></ins> shares the processes, scripts, and best practices to develop a custom ML model in Amazon SageMaker that applies deep learning (DL) techniques based on the concept outlined in the paper “GNHK: A Dataset for English Handwriting in the Wild” to transcribe text in images of handwritten passages into strings</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16s\" target=\"_blank\">Automate Container Anomaly Monitoring of Amazon Elastic Kubernetes Service Clusters with Amazon DevOps Guru</a></ins> read on to find out about new features in Amazon DevOps Guru to help simplify and expand the capabilities of the operator to address some of the challenges due to the increasing number of abstractions and supporting infrastructure when implementing observability.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/17d\" target=\"_blank\">Proactive autoscaling of Kubernetes workloads with KEDA using metrics ingested into Amazon Managed Service for Prometheus</a></ins> shows you how you can use Kubernetes based Event Driven Autoscaler (KEDA) to autoscale Amazon EKS Pods by querying the metrics stored in Amazon Managed Service for Prometheus</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16v\" target=\"_blank\">Implementing custom domain names with ROSA</a></ins> explains how to register a domain using Amazon Web Services registered domains, create a Route 53 hosted zone, and configure the Red Hat OpenShift Service on Amazon to make use of that custom domain.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16w\" target=\"_blank\">Replicate your data from Amazon Aurora MySQL to Amazon ElastiCache for Redis using Amazon DMS</a></ins> explores use cases and best practices when migrating data to an ElastiCache for Redis cluster.</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/177\" target=\"_blank\">How to fix SSH issues on EC2 Linux instances using Amazon Web Services Systems Manager</a></ins> shows you how you can use a feature of Amazon Web Services Systems Manager to tackle unreachable Linux instances, and fix common issues, such as OpenSSH file permissions, or gather system (OS) logs for analysis and troubleshooting</p>\n</li>\n<li>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/178\" target=\"_blank\">Cost savings by customizing metrics sent by Container Insights in Amazon EKS</a></ins> is a post that shares how to configure the ADOT Collector for an Amazon EKS cluster</p>\n</li>\n</ul>\n<h5><a id=\"Quick_updates_156\"></a><strong>Quick updates</strong></h5>\n<h6><a id=\"Spring_Boot_157\"></a><strong>Spring Boot</strong></h6>\n<p><ins><a href=\"https://aws-oss.beachgeek.co.uk/16y\" target=\"_blank\">v2.3.3</a></ins> is now available, and this version bumps a spring-messaging dependency to 5.3.13. Previous Spring Cloud Amazon Web Services versions relied on spring-messaging that suffered from a security vulnerability (#206). If you relied on Spring Cloud Amazon Web Services to determine spring-messaging version, please update to Spring Cloud Amazon Web Services 2.3.3. Other changes include:</p>\n<ul>\n<li>Fix: context order when loading properties (Parameter Store and Secrets Manager) - @WtfJoke</li>\n<li>Docs: Mention no Aurora support in RDS docs (RDS) - @aravindparappil46</li>\n<li>Dependency Upgrade: Upgrade Maven Wrapper - <ins><a href=\"https://dev.to/tinexw\" target=\"_blank\">@tinexw</a></ins></li>\n<li>Enhancement: Log exception on message processing failure (SQS) - @ebussieres</li>\n<li>Dependency Upgrade: Upgrade Spring Cloud Build to 3.0.5 - <ins><a href=\"https://dev.to/maciejwalkowiak\" target=\"_blank\">@maciejwalkowiak</a></ins></li>\n<li>Dependency Upgrade: Upgrade Amazon Web Services SDK to 1.12.129 - <ins><a href=\"https://dev.to/maciejwalkowiak\" target=\"_blank\">@maciejwalkowiak</a></ins></li>\n</ul>\n<h5><a id=\"Videos_of_the_week_168\"></a><strong>Videos of the week</strong></h5>\n<h6><a id=\"RoboCat_169\"></a><strong>RoboCat</strong></h6>\n<p>Loved this video, and now have ideas of how I can use my DeepRacer to do something similar. Searching for a humane way to scare mice out of his kitchen, Martin Paradesi modified an autonomous DeepRacer model car, and its open source code, to come up with a RoboCat that could scare mice away in the dark. Find out how his young sons contributed to the project.</p>\n<p><video src=\"https://dev-media.amazoncloud.cn/8ac5da9fb2234f3d933a3d095368cdeb_AWS%20Innovators%20-%20S1E6%EF%BC%9A%20Martin%20%EF%BD%9C%20Amazon%20Web%20Services.mp4\" controls=\"controls\"></video></p>\n<h5><a id=\"Events_for_your_diary_175\"></a><strong>Events for your diary</strong></h5>\n<p>Watch this space for events in 2022. If you have an event you want me to publish here, please contact me and I will include it in this listing.</p>\n<h5><a id=\"Stay_in_touch_with_open_source_at_Amazon_Web_Services_178\"></a><strong>Stay in touch with open source at Amazon Web Services</strong></h5>\n<p>I hope this summary has been useful. Remember to check out the <ins><a href=\"https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&amp;opensource-all.sort-order=asc\" target=\"_blank\">Open Source homepage</a></ins> to keep up to date with all our activity in open source by following us on <ins><a href=\"https://twitter.com/AWSOpen\" target=\"_blank\">@Amazon Web ServicesOpen</a></ins></p>\n"}