Open source news and updates, #57

{"value":"This week we have another great selection of content to share with you. Starting off with a look at open source at Amazon Web Services, which is a must read this week, we meander through a look at a write up of the open source technology stack that supported Fossdem a few weeks ago. Then it is off to the usual round up of latest open source projects, blog posts from the community and Amazon Web Services as well as a look at some quick updates, videos and more. We also have a job working Amazon Web Services SDK team, so if you love Rust why not take a look.\n\n#### **Open source at Amazon Web Services**\n\nIn this post in The New Stack, [The Open Source Strategy of Amazon Web Services](https://aws-oss.beachgeek.co.uk/79), Richard MacManus shares some thoughts on how Amazon Web Services think about and contribute to open source. A nice piece with some great data points.\n\n#### Fossdem\n\nA few weeks ago Fossdem ran virtually, and there were a number of great sessions over the weekend. It was important to get the technology right given the numbers attending these remotely, and certainly from the sessions I attended, it was a great success. In this blog post, [How we hosted FOSDEM 2021 on Matrix](https://aws-oss.beachgeek.co.uk/7a) Matthew Hodgson shares how Matrix, an open source project which defines an open standard protocol for decentralised communication, was used to deliver a virtual Fossdem. Some really great data points, a look at the architecture and open source tools used, this is a fantastic write up which I urge you to check out to see how you can use open source tools to potentially run your own virtual events.\n\n\n\n### **Events for your diary**\nA couple of events happening this week - still time to register and save your spot.\n\n#### **Innovate AI/ML**\n#### **Feb 24th**\n\nLast week I shared that I have been putting together some blog posts to support my session at the [Innovate AI/ML event](https://aws.amazon.com/events/aws-innovate/machine-learning/online/emea/?sc_channel=em&sc_campaign=EMEA_FIELD_WEBINAR_innovate-AIML_20210224_7014z000001MJbu&sc_medium=em_&sc_content=REG_t1_field&sc_geo=emea&sc_country=mult&sc_outcome=reg&sc_publisher=aws&trkCampaign=emea21_innovatemlq1&trk=em_emea21_innovatemlq1_ricardosueiras) happening on Feb, 24th. I have been working on more posts, and this week I managed to complete the fourth and fifth posts which you can find below. Use the [sign up link here](https://aws.amazon.com/events/aws-innovate/machine-learning/online/emea/?sc_channel=em&sc_campaign=EMEA_FIELD_WEBINAR_innovate-AIML_20210224_7014z000001MJbu&sc_medium=em_&sc_content=REG_t1_field&sc_geo=emea&sc_country=mult&sc_outcome=reg&sc_publisher=aws&trkCampaign=emea21_innovatemlq1&trk=em_emea21_innovatemlq1_ricardosueiras) to register for this event.\n\n#### **Apache Kafka**\n#### **Feb 25th**\n\n[Building ML-driven streaming applications with Apache Kafka](https://aws-oss.beachgeek.co.uk/4y) join Joseph Morais from Confluent and Kanchan Waikar from Amazon Web Services in this webinar to learn how to build Apache Kafka®-based streaming applications backed by machine learning models. The event is across three time zones so whether you are in Asia, Europe or the Americas, there will be a time you can attend.\n\n#### **CDK Day**\n#### **April 30th**\n\nAnnounced this week was the second [CDK Day](https://sessionize.com/cdkday/), which will be on April 30th. Check out [the web page](https://sessionize.com/cdkday/) to find out more about the first CDK Day, which was incredible. This second event promises to be even better. The CFP is open until the 19th of March. Check out this supporting blog post, [CDK Day CFP Is Open!!!!](https://aws-oss.beachgeek.co.uk/4v) from Matt as to what to expect and what they are looking for when it comes to sessions.\n\n#### **Cloud Native Rust Day**\n#### **May 3rd**\n\nRust is a language empowering everyone to build secure, reliable, and efficient software. Rust is becoming more widely used in cloud native, powering everything from lightning-fast service meshes and powerful developer tools to internet-scale distributed databases.\n\nCome explore what makes Rust a fantastic choice for new cloud native development, and learn about how the community uses Rust today. Find out [more and register here.](https://aws-oss.beachgeek.co.uk/5y)\n\n### **Open Source Jobs**\n#### **Rust**\n\nIf you are looking for an exciting new challenge, love Rust, then check out this role that is based out of New York, US. The Amazon Web Services SDK team is looking for a [Software Development Engineer - Amazon Web Services Rust SDK](https://www.amazon.jobs/en-gb/jobs/1424393/software-development-engineer-aws-rust-sdk?no_int_redir=1) to join the ever growing group of Rustaceans at Amazon Web Services.\n\n### **Celebrating open source contributors**\n\nThe articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.\n\nSo thank you to the following open source heroes: Pablo Redondo Sanchez, Pranshu Tople, Jiahang Zhong, Karen Xu, Mark Seufert, Jeff Wright, Kowshik Nagarajaan, Anush Krishnamurthy, Hugo Shi, Stephanie Kirmer, Kinnar Sen, Dan Kelly, Ram Vittal and Sireesha Muppala, Paul Roberts, Josh Izaac, Eric Kessler, William Cannady, Atiek Arian, Dominic Searle, Efe Selcuk, Apurup Chevuru, Michael Hausenblas, Martin Beeby, Adi Singh, Karsten Ploesser, Igor Alekseev, Scott Anderson, Guy Eisenkot, James Beswick, Richard MacManus, Matthew Hodgson, Christopher Catt, Tarık Yurt, Jochen Ullrich, Jon Grim, Prem Ranga, Jana Gnanachandran, Mona Mona, Nathalie Rauschmayr, Rohit Yadav, Daniel Pinheiro, Johny Duval, and Shawn Sachdev.\n\nMake sure you find and follow these builders and keep up to date with their open source projects and contributions.\n\n### **Latest from open source projects**\n#### **introspector**\n\n[introspector](https://aws-oss.beachgeek.co.uk/7d) this project from Gold Fig Labs is a tool and schema for importing cloud infrastructure configuration. The goal is to unlock the expressive power of SQL and relational databases to ask questions about what is currently deployed in your cloud.\n\n#### **infracost**\n\n[infracost](https://aws-oss.beachgeek.co.uk/7l) this project shows cloud cost estimates for Terraform projects. It helps developers, devops and others to quickly see the cost breakdown and compare different options upfront.\n\n#### **Amazon Web Services-pca-issuer**\n\n[Amazon Web Services-pca-issuer](https://aws-oss.beachgeek.co.uk/7e) this project from Jochen Ullrich's is an addon for cert-manager that issues certificates using the Amazon Web Services Certificate Manager. cert-manager is a Kubernetes add-on to automate the management and issuance of TLS certificates from various issuing sources. It will ensure certificates are valid and up to date periodically, and attempt to renew certificates at an appropriate time before expiry.\n\n#### **roll-with-me**\n\n[roll-with-me](https://aws-oss.beachgeek.co.uk/7f) this is a fun project from Jon Grim that I wish I had had during the days I used to do role playing (D&D, MERP and Judge Dredd if you were asking!). The project provides digital tools for playing roleplaying games online, with a sample demo you can try.\n\n#### **reweb**\n\n[reweb](https://aws-oss.beachgeek.co.uk/7g) is an interesting project from apparentorder that as the README.md says \"enables classic web applications to run on Amazon Web Services Lambda.\". Apart from answering the \"Why\" and going on to share some examples, I will be interested to know how folks get on with this project.\n\n#### **tecli**\n\n[tecli](https://aws-oss.beachgeek.co.uk/7h) is an open source tool from awslabs that provides a command line interface for Terraform Enterprise/Cloud. In a world where everything is Terraform, teams use Terraform Cloud API to manage their workloads. TECLI increases teams productivity by facilitating such interaction and by providing easy commands that can be executed on a terminal or on CI/CD systems.\n\n### **Community open source posts**\n#### **Apache Spark**\n\n[Run Spark Applications on Amazon Web Services Fargate](https://aws-oss.beachgeek.co.uk/7o) this post from DataChef walks you through how you can run your Spark applications on Amazon Web Services Fargate as a single node task. Aside from answering the question \"why\" and then exploring those use cases, they walk you through an example and provide source code too. Always good to have more choice, so whilst you will typically run your Spark applications on clusters, for those times when that is overkill, this might make a good alternative.\n\n#### **Terraform**\n\n[Terraform to manage application lifecycle](https://aws-oss.beachgeek.co.uk/7c) Tarık Yurt with a write up of lesson learned migrating and using Terraform as part of how they provision and deploy Amazon Web Services resources.\n\n#### **Amazon Web Services SDKs**\n\n[Jest: Mocking With Amazon Web Services SDK V3](https://aws-oss.beachgeek.co.uk/7b) Christopher Catt with a useful post for folks using the v3 update to the Amazon Web Services Javascript SDK. As part of the new V3 modular approach, it became less clear how developers might want to properly mock these new modules. Read this post and Chris will show you one way that makes mocking @aws-sdk client libraries a breeze.\n\n#### **ec2instances.info**\n\nec2instances.info is an open source project that allows you to compare EC2 instance metrics and pricing on Amazon's site. Last week, in the post [Vantage has acquired ec2instances.info](https://aws-oss.beachgeek.co.uk/78) Vantage shared news about a change of home for this project and try and answer any questions you might have if you were using this project.\n\n#### **Pupeteer**\n\n[Serverless browser automation with Amazon Web Services Lambda and Puppeteer](https://aws-oss.beachgeek.co.uk/77) Amazon Web Services's very own James Beswick writes how you can use an open source npm module called Puppeteer to deploy browser automation tasks in Amazon Web Services Lambda, allowing you to use the power and flexibility of Amazon Web Services Lambda to schedule, be triggered on an event, and scale as needed the use of browser based automation tasks in a way that is cost effective. Really nice post.\n\n#### **Cloud Drift Detection**\n\n[Cloud Drift Detection: How to Resolve Out-of-State Changes](https://aws-oss.beachgeek.co.uk/75) a few weeks ago I shared news about the project, [#53](https://aws-oss.beachgeek.co.uk/76), so it was great last week to see this nice post from Guy Eisenkot in TheNewStack. Understanding what is drift, knowing the risks, being able to detect drift and then how you respond are all topics Guy covers. Make sure you check this out as these are some really important concepts that are foundational when it comes to how you move to a more automated future.\n\n#### **Parliament**\n\n[Steampipe ❤ Parliament](https://aws-oss.beachgeek.co.uk/7m) this post from Steampipe shows how they were able to build on top of Parliament. Parliament is an open-source project from Duo Labs that is designed to automate the evaluation of IAM policies. Steampipe ended up using SQL to query Amazon Web Services Identity and Access Management (IAM), which helped them find new ways to assess and analyse our IAM risk\n\n### **Amazon Web Services open source posts**\n#### **Amazon Web Services App Mesh**\n\nIn the blog post, [Using mTLS with SPIFFE/SPIRE in Amazon Web Services App Mesh on Amazon EKS](https://aws-oss.beachgeek.co.uk/70) Efe Selcuk, Apurup Chevuru and Michael Hausenblas team up to share you how the mutual TLS (mTLS) feature in Amazon Web Services App Mesh works. This should be considered mandatory reading given that a) security is always job zero, and b) the post is nicely written and provides a great walkthrough you can try for yourself.\n\n\n\n#### **OpenTelemetry**\n\n[Building a prototype for the Logging API and SDK for the OpenTelemetry C++ library](https://aws-oss.beachgeek.co.uk/6s) Karen Xu and Mark Seufert, intern engineers on the open source observability team describe their design and implementation of an open source prototype Logging API and SDK for the OpenTelemetry C++ library. This library allows users to write and collect logs from their distributed and instrumented applications.\n\n\n\n#### **Elasticsearch**\n\n[Getting started with Trace Analytics in Amazon Elasticsearch Service](https://aws-oss.beachgeek.co.uk/6t) Jeff Wright, Kowshik Nagarajaan, and Anush Krishnamurthy write about some new capabilities available within Elasticsearch, specifically aimed at helping operational teams to troubleshoot performance and availability issues in their distributed applications. These feature provides a mechanism to ingest OpenTelemetry-standard trace data to be visualised and explored in Kibana.\n\n\n\n#### **Flutter**\n\n[Amplify Flutter is Now Generally Available: Build Beautiful Cross-Platform Apps](https://aws-oss.beachgeek.co.uk/72) nice post from Martin Beeby announcing the general availability of Amplify Flutter, which brings together Amazon Web Services Amplify and Flutter, to help customers who have invested in the Flutter ecosystem and now want to take advantage of the power of Amazon Web Services.\n\nAmazon Web Services CDK\n\n[Process Amazon Web Services Storage Gateway file upload notifications with Amazon Web Services CDK](https://aws-oss.beachgeek.co.uk/6z) Atiek Arian and Dominic Searle provide a sample use case of how you can use the open source project Amazon Web Services CDK, to build and deploy your entire application. Building from a previous post linked in this article, this is a very nicely written and clear example of how you can use Amazon Web Services CDK.\n\n\n\n#### **Dask**\n\nA couple of posts this week covering Dask, an open source library for parallel computing written in Python. Dask is a library composed of two parts. The first is a task scheduling component for building dependency graphs and scheduling tasks, and second, it includes the distributed data structures with APIs similar to Pandas Dataframes or NumPy arrays. Dask can scale from a single node and scale to thousand node clusters.\n\nIn the first blog post, [Computer Vision at Scale with Dask and PyTorch on Amazon EC2 Spot Instances](https://aws-oss.beachgeek.co.uk/6u) Hugo Shi (Co-Founder and CTO at Saturn), Stephanie Kirmer, Sr. Data Scientist at Saturn as well as Kinnar Sen and Dan Kelly from Amazon Web Services explain how Saturn Cloud makes it easy for customers to satisfy the performance requirements of many data science and ML workloads while optimising price performance. The post walks through how to provision a cluster of On-Demand and Spot Instances to meet a set of required performance specifications, and compares this against other approaches.\n\n\n\nNext up we have Ram Vittal and Sireesha Muppala, [Machine learning on distributed Dask using Amazon SageMaker and Amazon Web Services Fargate](https://aws-oss.beachgeek.co.uk/6v), which is a really nice follow on post where they demonstrate how to solve common ML problems such as exploratory data analysis on large datasets, preprocessing (such as one-hot encoding), and linear regression modelling using Fargate as the backend. They show you how to connect to a distributed Dask Fargate cluster from a SageMaker notebook, scale out Dask workers, and perform exploratory data analysis work using a sample data set along the way.\n\n\n\n#### **GluonTS**\n\n[Training, debugging and running time series forecasting models with the GluonTS toolkit on Amazon SageMaker](https://aws-oss.beachgeek.co.uk/7j) Prem Ranga, Jana Gnanachandran, Mona Mona, and Nathalie Rauschmayr show you how to set up and run time series forecasting models at scale using Gluon Time Series (GluonTS) on [Amazon SageMaker](https://aws.amazon.com/cn/sagemaker/?trk=cndc-detail). GluonTS is a Python toolkit for probabilistic time series modelling, built around Apache MXNet. GluonTS provides utilities for loading and iterating over time series datasets, state-of-the-art models ready to be trained, and building blocks to define your own models and quickly experiment with different solutions.\n\n#### **Robotics and IoT**\n\n[Deploying ROS applications as Snaps with Amazon Web Services IoT Greengrass 2.0](https://aws-oss.beachgeek.co.uk/74) my good friend Adi Singh has put together this really nice blog post that explores the recently announced release of Amazon Web Services IoT Greengrass 2.0 that now some new options to package up your applications, why this improvement is useful for the robotics community, and walk through how you package and deploy Robot Operating System (ROS) applications to devices using Amazon Web Services IoT Greengrass 2.0. Lots of great stuff, covering specifically how to use Snaps, the packaging tool developed by Canonical. This is on my weekend \"to do\" list. Great stuff Adi!\n\n\n\n#### **MacOS workers on GitLab**\n\n[Integrating EC2 macOS workers with EKS and GitLab](https://aws-oss.beachgeek.co.uk/6w) Paul Roberts walks through configuring GitLab with a mac1.metal [Amazon EC2 ](https://aws.amazon.com/cn/ec2/?trk=cndc-detail)instance using another open source infrastructure as code (IaC) automation tool, Pulumi, so that developers can build, test, and package their applications for all Apple platforms, such as macOS, iOS, iPadOS, tvOS, and watchOS.\n\n#### **Babylon.js**\n\n[How to: Hands-free interaction for AR/VR with Amazon Lex and Babylon.js](https://aws-oss.beachgeek.co.uk/6y) William Cannady takes a look at how you can use Babylon.js, and open source library that makes it easy get started working with 3D content, and use it in conjunction with Amazon Web Services services to create immersive augmented/virtual reality applications. In this instance, by using voice/chat services that [Amazon Lex](https://aws.amazon.com/cn/lex/?trk=cndc-detail) provides.\n\n\n\n#### **[Amazon Athena](https: //aws.amazon.com/cn/athena/?trk=cndc-detail) Federated Queries**\n\n[Create a custom data connector to Slack’s Member Analytics API in Amazon QuickSight with Amazon Athena Federated Query](https://aws-oss.beachgeek.co.uk/7n) Pablo Redondo Sanchez writes about how to use the Athena Query Federation SDK to write custom connectors and query any source accessible with a Java API, whether it is relational, non-relational, object, or a custom data endpoint. The [Amazon Athena](https: //aws.amazon.com/cn/athena/?trk=cndc-detail) Query Federation SDK is an open source project that allows you to customise [Amazon Athena](https: //aws.amazon.com/cn/athena/?trk=cndc-detail) with your own data sources and code. In this example, Pablo shows you how to create a custom connector to interact with Slack. Read on to find out what he does with it.\n\n\n\n#### **Apache Kafka**\n\n[Amazon MSK backup for Archival, Replay, or Analytics](https://aws-oss.beachgeek.co.uk/7k) Rohit Yadav, Daniel Pinheiro, Johny Duval, and Shawn Sachdev with a post that shares an architecture to build a scalable, highly available real-time archival of Amazon MSK topics to long term storage in [Amazon S3](https://aws.amazon.com/cn/s3/?trk=cndc-detail).\n\n\n\n### Case Studies\n#### SageMaker Clarify\n\n[How Zopa enhanced their fraud detection application using Amazon SageMaker Clarify](https://aws-oss.beachgeek.co.uk/7i) Jiahang Zhong, Head of Data Science at Zopa, writes how Zopa’s fraud detection system for loans use [Amazon SageMaker](https://aws.amazon.com/cn/sagemaker/?trk=cndc-detail) Clarify to explain their ML models. Zopa is a UK-based digital bank and peer to peer (P2P) lender. In 2005, Zopa launched the first ever P2P lending company to give people access to simpler, better-value loans and investments. SageMaker Clarify is an open source project that helps you with bias detection and mitigation for datasets and models.\n\n\n\n### **Partners**\n#### **PennyLane**\n\n[Creating a bridge between machine learning and quantum computing with PennyLane](https://aws-oss.beachgeek.co.uk/6x) Josh Izaac (Quantum Software Team Lead at Xanadu) and Eric Kessler from Amazon Web Services explain how the open source PennyLane project helps bridge the gap between the quantum computing and machine learning communities. The ambition here is that by integrating quantum computing into a rich scientific and machine learning ecosystem, the field of quantum computing can move forward.\n\n\n\n#### **Couchbase**\n\n[Simplified Cloud Database Management Using Couchbase Cloud and Amazon Web Services](https://aws-oss.beachgeek.co.uk/73) Scott Anderson, SVP Product Management and Business Operations at Couchbase describe how Couchbase Cloud leverages the underlying cloud resources. Couchbase NoSQL database administrators have been using Amazon Web Services (Amazon Web Services) to host clusters for many years, including stand-alone servers, small or large clusters, and more recently Kubernetes-managed configurations. Couchbase Cloud takes aim at this challenge by providing customers access to sophisticated management software that allows them to co-manage their NoSQL cloud database directly inside their Amazon Web Services-powered infrastructure.\n\n\n\n**Splunk**\n\n[Monitoring Your Linux Workloads on Amazon Web Services Graviton with Splunk Cloud](https://aws-oss.beachgeek.co.uk/71) Karsten Ploesser and Igor Alekseev share how you can use an Amazon Web Services Partner solution (Splunk Cloud) with Amazon Web Services Graviton2 instances using their Splunk Universal Forwarders to automate data collection and indexing of machine data.\n\n\n\n### **Videos of the week**\n#### **Curiosity Rover**\n\nTo celebrate last weeks incredible MARS landing by the NASA Curiosity Rover, why not check out this video where Pranshu Tople simulates Curiosity using ROS.\n\n<video src=\\"https://dev-media.amazoncloud.cn/705512250f5e46b3a59160c17ca48274_Simulating%20Curiosity%20Rover%20using%20ROS%20%EF%BD%9C%EF%BD%9C%20Aiming%20to%20be%20NASA%20Engineer%20-%20Learn%20to%20Code%20Mars%20Rover%21.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\nIf you feel excited by that, why not check out the Amazon Web Services RoboMaker workshop that was run last year with [JPL Open Source Rover challenge](https://aws-oss.beachgeek.co.uk/7m).\n\n#### Prometheus and Grafana\n\nAnother great session from the Containers from the Couch team, together with guests Jaana Dogan, Alolita Sharma, and Imaya Jagannathan that show you how you can monitor container workloads with [Amazon Managed Service for Prometheus](https://aws.amazon.com/cn/prometheus/?trk=cndc-detail) and Grafana.\n\n<video src=\\"https://dev-media.amazoncloud.cn/e42fcf4adcb944c6966cf6cd5bf79331_Monitoring%20container%20workloads%20with%20Amazon%20Managed%20Service%20for%20Prometheus%20and%20Grafana.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n\n### **Quick updates**\n#### **Kubernetes**\n\n- [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail) and EKS Distro now supports Kubernetes version 1.19. Kubernetes is rapidly evolving, with frequent feature releases and bug fixes. Highlights of the Kubernetes 1.19 release include Ingress API and Pod Topology Spread reaching stable status, EndpointSlices being enabled by default, and immutable Secrets and ConfigMaps.\n- Kubernetes version 1.15 will no longer be supported on May 3rd, 2021. [Read more here](https://aws.amazon.com/about-aws/whats-new/2021/02/amazon-eks-supports-kubernetes-version-1-19/).\n\n#### **Flutter**\n\nFlutter support in Amazon Web Services Amplify is now generally available (GA). Amplify is a set of tools and services that help frontend web and mobile developers build secure, scalable, full-stack applications. Flutter is an open-source UI software development kit created by Google for developing applications for Android and iOS from a single codebase. Amplify Flutter brings together Amplify and Flutter. It is designed for developers who have invested in the Flutter ecosystem and now want to take advantage of the power of Amazon Web Services. You can use the Amplify Flutter libraries with Amplify-created backends, as well as existing Amazon Web Services backends.\n\nCompared to the initial Developer Preview, the GA release adds Data, API, and Auth capabilities. Amplify DataStore, now supported in Amplify Flutter, provides a local programming model that makes working with distributed, cross-user data as simple as working with local-only data. No additional code is required for offline and online scenarios. Amplify Flutter’s new API capabilities provide clients for making signed HTTP requests to both GraphQL and REST endpoints. Finally, today’s GA release adds support for authenticating app users using Hosted UI. Hosted UI is a customizable OAuth 2.0 flow that allows developers to launch a login screen without embedding the SDK for Cognito or a social provider—such as Facebook, Google, and Amazon—in your application.\n\n#### **Elasticsearch**\n\nAmazon Elasticsearch Service adds Trace Analytics, a new feature for distributed tracing that enables developers and IT operators to find and fix performance problems in distributed applications, leading to faster problem resolution times.\n\nTrace Analytics enables developers and IT Ops to troubleshoot performance and availability issues in their distributed applications, giving them end-to-end insights not possible with traditional methods of collecting logs and metrics from each component and service individually. By adding trace data to the existing log analytics capabilities of Amazon Elasticsearch Service, customers can use the same service to both isolate the source of performance problems and diagnose their root cause. Trace Analytics supports OpenTelemetry, a Cloud Native Computing Foundation (CNCF) project which provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics, enabling customers to leverage Trace Analytics without having to re-instrument they applications.\n\nTrace Analytics today supports collection of trace data from application libraries and SDK’s that are compatible with the open source OpenTelemetry Collector, including OpenTelemetry SDKs, X-Ray SDKs, Jaeger and Zipkin SDKs. Trace Analytics also integrates with Amazon Web Services Distro for OpenTelemetry, which is a distribution of OpenTelemetry APIs, SDKs, and agents/collectors. It is a performant and secure distribution of OpenTelemetry supported by Amazon Web Services. Customers can use Amazon Web Services Distro for OpenTelemetry to collect traces and metrics for multiple monitoring solutions, including Amazon Elasticsearch Service and Amazon Web Services X-Ray for trace data, and [Amazon CloudWatch](https://aws.amazon.com/cn/cloudwatch/?trk=cndc-detail) for metrics. For more information on configuring and using Trace Analytics, please see documentation.\n\n### **Stay in touch with open source at Amazon Web Services**\n\nI hope this summary has been useful. Remember to check out the [Open Source homepage](https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&opensource-all.sort-order=asc) to keep up to date with all our activity in open source by following us on [@AWSOpen](https://twitter.com/AWSOpen).\n","render":"<p>This week we have another great selection of content to share with you. Starting off with a look at open source at Amazon Web Services, which is a must read this week, we meander through a look at a write up of the open source technology stack that supported Fossdem a few weeks ago. Then it is off to the usual round up of latest open source projects, blog posts from the community and Amazon Web Services as well as a look at some quick updates, videos and more. We also have a job working Amazon Web Services SDK team, so if you love Rust why not take a look.</p>\n<h4><a id=\\"Open_source_at_Amazon_Web_Services_2\\"></a><strong>Open source at Amazon Web Services</strong></h4>\\n<p>In this post in The New Stack, <a href=\\"https://aws-oss.beachgeek.co.uk/79\\" target=\\"_blank\\">The Open Source Strategy of Amazon Web Services</a>, Richard MacManus shares some thoughts on how Amazon Web Services think about and contribute to open source. A nice piece with some great data points.</p>\\n<h4><a id=\\"Fossdem_6\\"></a>Fossdem</h4>\\n<p>A few weeks ago Fossdem ran virtually, and there were a number of great sessions over the weekend. It was important to get the technology right given the numbers attending these remotely, and certainly from the sessions I attended, it was a great success. In this blog post, <a href=\\"https://aws-oss.beachgeek.co.uk/7a\\" target=\\"_blank\\">How we hosted FOSDEM 2021 on Matrix</a> Matthew Hodgson shares how Matrix, an open source project which defines an open standard protocol for decentralised communication, was used to deliver a virtual Fossdem. Some really great data points, a look at the architecture and open source tools used, this is a fantastic write up which I urge you to check out to see how you can use open source tools to potentially run your own virtual events.</p>\\n<p><img src=\\"1\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"Events_for_your_diary_12\\"></a><strong>Events for your diary</strong></h3>\\n<p>A couple of events happening this week - still time to register and save your spot.</p>\n<h4><a id=\\"Innovate_AIML_15\\"></a><strong>Innovate AI/ML</strong></h4>\\n<h4><a id=\\"Feb_24th_16\\"></a><strong>Feb 24th</strong></h4>\\n<p>Last week I shared that I have been putting together some blog posts to support my session at the <a href=\\"https://aws.amazon.com/events/aws-innovate/machine-learning/online/emea/?sc_channel=em&amp;sc_campaign=EMEA_FIELD_WEBINAR_innovate-AIML_20210224_7014z000001MJbu&amp;sc_medium=em_&amp;sc_content=REG_t1_field&amp;sc_geo=emea&amp;sc_country=mult&amp;sc_outcome=reg&amp;sc_publisher=aws&amp;trkCampaign=emea21_innovatemlq1&amp;trk=em_emea21_innovatemlq1_ricardosueiras\\" target=\\"_blank\\">Innovate AI/ML event</a> happening on Feb, 24th. I have been working on more posts, and this week I managed to complete the fourth and fifth posts which you can find below. Use the <a href=\\"https://aws.amazon.com/events/aws-innovate/machine-learning/online/emea/?sc_channel=em&amp;sc_campaign=EMEA_FIELD_WEBINAR_innovate-AIML_20210224_7014z000001MJbu&amp;sc_medium=em_&amp;sc_content=REG_t1_field&amp;sc_geo=emea&amp;sc_country=mult&amp;sc_outcome=reg&amp;sc_publisher=aws&amp;trkCampaign=emea21_innovatemlq1&amp;trk=em_emea21_innovatemlq1_ricardosueiras\\" target=\\"_blank\\">sign up link here</a> to register for this event.</p>\\n<h4><a id=\\"Apache_Kafka_20\\"></a><strong>Apache Kafka</strong></h4>\\n<h4><a id=\\"Feb_25th_21\\"></a><strong>Feb 25th</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/4y\\" target=\\"_blank\\">Building ML-driven streaming applications with Apache Kafka</a> join Joseph Morais from Confluent and Kanchan Waikar from Amazon Web Services in this webinar to learn how to build Apache Kafka®-based streaming applications backed by machine learning models. The event is across three time zones so whether you are in Asia, Europe or the Americas, there will be a time you can attend.</p>\\n<h4><a id=\\"CDK_Day_25\\"></a><strong>CDK Day</strong></h4>\\n<h4><a id=\\"April_30th_26\\"></a><strong>April 30th</strong></h4>\\n<p>Announced this week was the second <a href=\\"https://sessionize.com/cdkday/\\" target=\\"_blank\\">CDK Day</a>, which will be on April 30th. Check out <a href=\\"https://sessionize.com/cdkday/\\" target=\\"_blank\\">the web page</a> to find out more about the first CDK Day, which was incredible. This second event promises to be even better. The CFP is open until the 19th of March. Check out this supporting blog post, <a href=\\"https://aws-oss.beachgeek.co.uk/4v\\" target=\\"_blank\\">CDK Day CFP Is Open!!!</a> from Matt as to what to expect and what they are looking for when it comes to sessions.</p>\\n<h4><a id=\\"Cloud_Native_Rust_Day_30\\"></a><strong>Cloud Native Rust Day</strong></h4>\\n<h4><a id=\\"May_3rd_31\\"></a><strong>May 3rd</strong></h4>\\n<p>Rust is a language empowering everyone to build secure, reliable, and efficient software. Rust is becoming more widely used in cloud native, powering everything from lightning-fast service meshes and powerful developer tools to internet-scale distributed databases.</p>\n<p>Come explore what makes Rust a fantastic choice for new cloud native development, and learn about how the community uses Rust today. Find out <a href=\\"https://aws-oss.beachgeek.co.uk/5y\\" target=\\"_blank\\">more and register here.</a></p>\\n<h3><a id=\\"Open_Source_Jobs_37\\"></a><strong>Open Source Jobs</strong></h3>\\n<h4><a id=\\"Rust_38\\"></a><strong>Rust</strong></h4>\\n<p>If you are looking for an exciting new challenge, love Rust, then check out this role that is based out of New York, US. The Amazon Web Services SDK team is looking for a <a href=\\"https://www.amazon.jobs/en-gb/jobs/1424393/software-development-engineer-aws-rust-sdk?no_int_redir=1\\" target=\\"_blank\\">Software Development Engineer - Amazon Web Services Rust SDK</a> to join the ever growing group of Rustaceans at Amazon Web Services.</p>\\n<h3><a id=\\"Celebrating_open_source_contributors_42\\"></a><strong>Celebrating open source contributors</strong></h3>\\n<p>The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.</p>\n<p>So thank you to the following open source heroes: Pablo Redondo Sanchez, Pranshu Tople, Jiahang Zhong, Karen Xu, Mark Seufert, Jeff Wright, Kowshik Nagarajaan, Anush Krishnamurthy, Hugo Shi, Stephanie Kirmer, Kinnar Sen, Dan Kelly, Ram Vittal and Sireesha Muppala, Paul Roberts, Josh Izaac, Eric Kessler, William Cannady, Atiek Arian, Dominic Searle, Efe Selcuk, Apurup Chevuru, Michael Hausenblas, Martin Beeby, Adi Singh, Karsten Ploesser, Igor Alekseev, Scott Anderson, Guy Eisenkot, James Beswick, Richard MacManus, Matthew Hodgson, Christopher Catt, Tarık Yurt, Jochen Ullrich, Jon Grim, Prem Ranga, Jana Gnanachandran, Mona Mona, Nathalie Rauschmayr, Rohit Yadav, Daniel Pinheiro, Johny Duval, and Shawn Sachdev.</p>\n<p>Make sure you find and follow these builders and keep up to date with their open source projects and contributions.</p>\n<h3><a id=\\"Latest_from_open_source_projects_50\\"></a><strong>Latest from open source projects</strong></h3>\\n<h4><a id=\\"introspector_51\\"></a><strong>introspector</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7d\\" target=\\"_blank\\">introspector</a> this project from Gold Fig Labs is a tool and schema for importing cloud infrastructure configuration. The goal is to unlock the expressive power of SQL and relational databases to ask questions about what is currently deployed in your cloud.</p>\\n<h4><a id=\\"infracost_55\\"></a><strong>infracost</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7l\\" target=\\"_blank\\">infracost</a> this project shows cloud cost estimates for Terraform projects. It helps developers, devops and others to quickly see the cost breakdown and compare different options upfront.</p>\\n<h4><a id=\\"Amazon_Web_Servicespcaissuer_59\\"></a><strong>Amazon Web Services-pca-issuer</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7e\\" target=\\"_blank\\">Amazon Web Services-pca-issuer</a> this project from Jochen Ullrich’s is an addon for cert-manager that issues certificates using the Amazon Web Services Certificate Manager. cert-manager is a Kubernetes add-on to automate the management and issuance of TLS certificates from various issuing sources. It will ensure certificates are valid and up to date periodically, and attempt to renew certificates at an appropriate time before expiry.</p>\\n<h4><a id=\\"rollwithme_63\\"></a><strong>roll-with-me</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7f\\" target=\\"_blank\\">roll-with-me</a> this is a fun project from Jon Grim that I wish I had had during the days I used to do role playing (D&amp;D, MERP and Judge Dredd if you were asking!). The project provides digital tools for playing roleplaying games online, with a sample demo you can try.</p>\\n<h4><a id=\\"reweb_67\\"></a><strong>reweb</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7g\\" target=\\"_blank\\">reweb</a> is an interesting project from apparentorder that as the README.md says “enables classic web applications to run on Amazon Web Services Lambda.”. Apart from answering the “Why” and going on to share some examples, I will be interested to know how folks get on with this project.</p>\\n<h4><a id=\\"tecli_71\\"></a><strong>tecli</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7h\\" target=\\"_blank\\">tecli</a> is an open source tool from awslabs that provides a command line interface for Terraform Enterprise/Cloud. In a world where everything is Terraform, teams use Terraform Cloud API to manage their workloads. TECLI increases teams productivity by facilitating such interaction and by providing easy commands that can be executed on a terminal or on CI/CD systems.</p>\\n<h3><a id=\\"Community_open_source_posts_75\\"></a><strong>Community open source posts</strong></h3>\\n<h4><a id=\\"Apache_Spark_76\\"></a><strong>Apache Spark</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7o\\" target=\\"_blank\\">Run Spark Applications on Amazon Web Services Fargate</a> this post from DataChef walks you through how you can run your Spark applications on Amazon Web Services Fargate as a single node task. Aside from answering the question “why” and then exploring those use cases, they walk you through an example and provide source code too. Always good to have more choice, so whilst you will typically run your Spark applications on clusters, for those times when that is overkill, this might make a good alternative.</p>\\n<h4><a id=\\"Terraform_80\\"></a><strong>Terraform</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7c\\" target=\\"_blank\\">Terraform to manage application lifecycle</a> Tarık Yurt with a write up of lesson learned migrating and using Terraform as part of how they provision and deploy Amazon Web Services resources.</p>\\n<h4><a id=\\"Amazon_Web_Services_SDKs_84\\"></a><strong>Amazon Web Services SDKs</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7b\\" target=\\"_blank\\">Jest: Mocking With Amazon Web Services SDK V3</a> Christopher Catt with a useful post for folks using the v3 update to the Amazon Web Services Javascript SDK. As part of the new V3 modular approach, it became less clear how developers might want to properly mock these new modules. Read this post and Chris will show you one way that makes mocking @aws-sdk client libraries a breeze.</p>\\n<h4><a id=\\"ec2instancesinfo_88\\"></a><strong>ec2instances.info</strong></h4>\\n<p>ec2instances.info is an open source project that allows you to compare EC2 instance metrics and pricing on Amazon’s site. Last week, in the post <a href=\\"https://aws-oss.beachgeek.co.uk/78\\" target=\\"_blank\\">Vantage has acquired ec2instances.info</a> Vantage shared news about a change of home for this project and try and answer any questions you might have if you were using this project.</p>\\n<h4><a id=\\"Pupeteer_92\\"></a><strong>Pupeteer</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/77\\" target=\\"_blank\\">Serverless browser automation with Amazon Web Services Lambda and Puppeteer</a> Amazon Web Services’s very own James Beswick writes how you can use an open source npm module called Puppeteer to deploy browser automation tasks in Amazon Web Services Lambda, allowing you to use the power and flexibility of Amazon Web Services Lambda to schedule, be triggered on an event, and scale as needed the use of browser based automation tasks in a way that is cost effective. Really nice post.</p>\\n<h4><a id=\\"Cloud_Drift_Detection_96\\"></a><strong>Cloud Drift Detection</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/75\\" target=\\"_blank\\">Cloud Drift Detection: How to Resolve Out-of-State Changes</a> a few weeks ago I shared news about the project, <a href=\\"https://aws-oss.beachgeek.co.uk/76\\" target=\\"_blank\\">#53</a>, so it was great last week to see this nice post from Guy Eisenkot in TheNewStack. Understanding what is drift, knowing the risks, being able to detect drift and then how you respond are all topics Guy covers. Make sure you check this out as these are some really important concepts that are foundational when it comes to how you move to a more automated future.</p>\\n<h4><a id=\\"Parliament_100\\"></a><strong>Parliament</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7m\\" target=\\"_blank\\">Steampipe ❤ Parliament</a> this post from Steampipe shows how they were able to build on top of Parliament. Parliament is an open-source project from Duo Labs that is designed to automate the evaluation of IAM policies. Steampipe ended up using SQL to query Amazon Web Services Identity and Access Management (IAM), which helped them find new ways to assess and analyse our IAM risk</p>\\n<h3><a id=\\"Amazon_Web_Services_open_source_posts_104\\"></a><strong>Amazon Web Services open source posts</strong></h3>\\n<h4><a id=\\"Amazon_Web_Services_App_Mesh_105\\"></a><strong>Amazon Web Services App Mesh</strong></h4>\\n<p>In the blog post, <a href=\\"https://aws-oss.beachgeek.co.uk/70\\" target=\\"_blank\\">Using mTLS with SPIFFE/SPIRE in Amazon Web Services App Mesh on Amazon EKS</a> Efe Selcuk, Apurup Chevuru and Michael Hausenblas team up to share you how the mutual TLS (mTLS) feature in Amazon Web Services App Mesh works. This should be considered mandatory reading given that a) security is always job zero, and b) the post is nicely written and provides a great walkthrough you can try for yourself.</p>\\n<p><img src=\\"2\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"OpenTelemetry_111\\"></a><strong>OpenTelemetry</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/6s\\" target=\\"_blank\\">Building a prototype for the Logging API and SDK for the OpenTelemetry C++ library</a> Karen Xu and Mark Seufert, intern engineers on the open source observability team describe their design and implementation of an open source prototype Logging API and SDK for the OpenTelemetry C++ library. This library allows users to write and collect logs from their distributed and instrumented applications.</p>\\n<p><img src=\\"3\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"Elasticsearch_117\\"></a><strong>Elasticsearch</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/6t\\" target=\\"_blank\\">Getting started with Trace Analytics in Amazon Elasticsearch Service</a> Jeff Wright, Kowshik Nagarajaan, and Anush Krishnamurthy write about some new capabilities available within Elasticsearch, specifically aimed at helping operational teams to troubleshoot performance and availability issues in their distributed applications. These feature provides a mechanism to ingest OpenTelemetry-standard trace data to be visualised and explored in Kibana.</p>\\n<p><img src=\\"4\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"Flutter_123\\"></a><strong>Flutter</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/72\\" target=\\"_blank\\">Amplify Flutter is Now Generally Available: Build Beautiful Cross-Platform Apps</a> nice post from Martin Beeby announcing the general availability of Amplify Flutter, which brings together Amazon Web Services Amplify and Flutter, to help customers who have invested in the Flutter ecosystem and now want to take advantage of the power of Amazon Web Services.</p>\\n<p>Amazon Web Services CDK</p>\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/6z\\" target=\\"_blank\\">Process Amazon Web Services Storage Gateway file upload notifications with Amazon Web Services CDK</a> Atiek Arian and Dominic Searle provide a sample use case of how you can use the open source project Amazon Web Services CDK, to build and deploy your entire application. Building from a previous post linked in this article, this is a very nicely written and clear example of how you can use Amazon Web Services CDK.</p>\\n<p><img src=\\"5\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"Dask_133\\"></a><strong>Dask</strong></h4>\\n<p>A couple of posts this week covering Dask, an open source library for parallel computing written in Python. Dask is a library composed of two parts. The first is a task scheduling component for building dependency graphs and scheduling tasks, and second, it includes the distributed data structures with APIs similar to Pandas Dataframes or NumPy arrays. Dask can scale from a single node and scale to thousand node clusters.</p>\n<p>In the first blog post, <a href=\\"https://aws-oss.beachgeek.co.uk/6u\\" target=\\"_blank\\">Computer Vision at Scale with Dask and PyTorch on Amazon EC2 Spot Instances</a> Hugo Shi (Co-Founder and CTO at Saturn), Stephanie Kirmer, Sr. Data Scientist at Saturn as well as Kinnar Sen and Dan Kelly from Amazon Web Services explain how Saturn Cloud makes it easy for customers to satisfy the performance requirements of many data science and ML workloads while optimising price performance. The post walks through how to provision a cluster of On-Demand and Spot Instances to meet a set of required performance specifications, and compares this against other approaches.</p>\\n<p><img src=\\"6\\" alt=\\"image.png\\" /></p>\n<p>Next up we have Ram Vittal and Sireesha Muppala, <a href=\\"https://aws-oss.beachgeek.co.uk/6v\\" target=\\"_blank\\">Machine learning on distributed Dask using Amazon SageMaker and Amazon Web Services Fargate</a>, which is a really nice follow on post where they demonstrate how to solve common ML problems such as exploratory data analysis on large datasets, preprocessing (such as one-hot encoding), and linear regression modelling using Fargate as the backend. They show you how to connect to a distributed Dask Fargate cluster from a SageMaker notebook, scale out Dask workers, and perform exploratory data analysis work using a sample data set along the way.</p>\\n<p><img src=\\"7\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"GluonTS_145\\"></a><strong>GluonTS</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7j\\" target=\\"_blank\\">Training, debugging and running time series forecasting models with the GluonTS toolkit on Amazon SageMaker</a> Prem Ranga, Jana Gnanachandran, Mona Mona, and Nathalie Rauschmayr show you how to set up and run time series forecasting models at scale using Gluon Time Series (GluonTS) on [Amazon SageMaker](https://aws.amazon.com/cn/sagemaker/?trk=cndc-detail). GluonTS is a Python toolkit for probabilistic time series modelling, built around Apache MXNet. GluonTS provides utilities for loading and iterating over time series datasets, state-of-the-art models ready to be trained, and building blocks to define your own models and quickly experiment with different solutions.</p>\\n<h4><a id=\\"Robotics_and_IoT_149\\"></a><strong>Robotics and IoT</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/74\\" target=\\"_blank\\">Deploying ROS applications as Snaps with Amazon Web Services IoT Greengrass 2.0</a> my good friend Adi Singh has put together this really nice blog post that explores the recently announced release of Amazon Web Services IoT Greengrass 2.0 that now some new options to package up your applications, why this improvement is useful for the robotics community, and walk through how you package and deploy Robot Operating System (ROS) applications to devices using Amazon Web Services IoT Greengrass 2.0. Lots of great stuff, covering specifically how to use Snaps, the packaging tool developed by Canonical. This is on my weekend “to do” list. Great stuff Adi!</p>\\n<p><img src=\\"8\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"MacOS_workers_on_GitLab_155\\"></a><strong>MacOS workers on GitLab</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/6w\\" target=\\"_blank\\">Integrating EC2 macOS workers with EKS and GitLab</a> Paul Roberts walks through configuring GitLab with a mac1.metal [Amazon EC2 ](https://aws.amazon.com/cn/ec2/?trk=cndc-detail)instance using another open source infrastructure as code (IaC) automation tool, Pulumi, so that developers can build, test, and package their applications for all Apple platforms, such as macOS, iOS, iPadOS, tvOS, and watchOS.</p>\\n<h4><a id=\\"Babylonjs_159\\"></a><strong>Babylon.js</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/6y\\" target=\\"_blank\\">How to: Hands-free interaction for AR/VR with Amazon Lex and Babylon.js</a> William Cannady takes a look at how you can use Babylon.js, and open source library that makes it easy get started working with 3D content, and use it in conjunction with Amazon Web Services services to create immersive augmented/virtual reality applications. In this instance, by using voice/chat services that [Amazon Lex](https://aws.amazon.com/cn/lex/?trk=cndc-detail) provides.</p>\\n<p><img src=\\"9\\" alt=\\"FinalProductmin.gif\\" /></p>\n<h4><a id=\\"Amazon_Athena_Federated_Queries_165\\"></a><strong>Amazon Athena Federated Queries</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7n\\" target=\\"_blank\\">Create a custom data connector to Slack’s Member Analytics API in Amazon QuickSight with Amazon Athena Federated Query</a> Pablo Redondo Sanchez writes about how to use the Athena Query Federation SDK to write custom connectors and query any source accessible with a Java API, whether it is relational, non-relational, object, or a custom data endpoint. The [Amazon Athena](https: //aws.amazon.com/cn/athena/?trk=cndc-detail) Query Federation SDK is an open source project that allows you to customise [Amazon Athena](https: //aws.amazon.com/cn/athena/?trk=cndc-detail) with your own data sources and code. In this example, Pablo shows you how to create a custom connector to interact with Slack. Read on to find out what he does with it.</p>\\n<p><img src=\\"10\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"Apache_Kafka_171\\"></a><strong>Apache Kafka</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7k\\" target=\\"_blank\\">Amazon MSK backup for Archival, Replay, or Analytics</a> Rohit Yadav, Daniel Pinheiro, Johny Duval, and Shawn Sachdev with a post that shares an architecture to build a scalable, highly available real-time archival of Amazon MSK topics to long term storage in [Amazon S3](https://aws.amazon.com/cn/s3/?trk=cndc-detail).</p>\\n<p><img src=\\"11\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"Case_Studies_177\\"></a>Case Studies</h3>\\n<h4><a id=\\"SageMaker_Clarify_178\\"></a>SageMaker Clarify</h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/7i\\" target=\\"_blank\\">How Zopa enhanced their fraud detection application using Amazon SageMaker Clarify</a> Jiahang Zhong, Head of Data Science at Zopa, writes how Zopa’s fraud detection system for loans use [Amazon SageMaker](https://aws.amazon.com/cn/sagemaker/?trk=cndc-detail) Clarify to explain their ML models. Zopa is a UK-based digital bank and peer to peer (P2P) lender. In 2005, Zopa launched the first ever P2P lending company to give people access to simpler, better-value loans and investments. SageMaker Clarify is an open source project that helps you with bias detection and mitigation for datasets and models.</p>\\n<p><img src=\\"12\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"Partners_184\\"></a><strong>Partners</strong></h3>\\n<h4><a id=\\"PennyLane_185\\"></a><strong>PennyLane</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/6x\\" target=\\"_blank\\">Creating a bridge between machine learning and quantum computing with PennyLane</a> Josh Izaac (Quantum Software Team Lead at Xanadu) and Eric Kessler from Amazon Web Services explain how the open source PennyLane project helps bridge the gap between the quantum computing and machine learning communities. The ambition here is that by integrating quantum computing into a rich scientific and machine learning ecosystem, the field of quantum computing can move forward.</p>\\n<p><img src=\\"13\\" alt=\\"image.png\\" /></p>\n<h4><a id=\\"Couchbase_191\\"></a><strong>Couchbase</strong></h4>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/73\\" target=\\"_blank\\">Simplified Cloud Database Management Using Couchbase Cloud and Amazon Web Services</a> Scott Anderson, SVP Product Management and Business Operations at Couchbase describe how Couchbase Cloud leverages the underlying cloud resources. Couchbase NoSQL database administrators have been using Amazon Web Services (Amazon Web Services) to host clusters for many years, including stand-alone servers, small or large clusters, and more recently Kubernetes-managed configurations. Couchbase Cloud takes aim at this challenge by providing customers access to sophisticated management software that allows them to co-manage their NoSQL cloud database directly inside their Amazon Web Services-powered infrastructure.</p>\\n<p><img src=\\"14\\" alt=\\"image.png\\" /></p>\n<p><strong>Splunk</strong></p>\\n<p><a href=\\"https://aws-oss.beachgeek.co.uk/71\\" target=\\"_blank\\">Monitoring Your Linux Workloads on Amazon Web Services Graviton with Splunk Cloud</a> Karsten Ploesser and Igor Alekseev share how you can use an Amazon Web Services Partner solution (Splunk Cloud) with Amazon Web Services Graviton2 instances using their Splunk Universal Forwarders to automate data collection and indexing of machine data.</p>\\n<p><img src=\\"15\\" alt=\\"image.png\\" /></p>\n<h3><a id=\\"Videos_of_the_week_203\\"></a><strong>Videos of the week</strong></h3>\\n<h4><a id=\\"Curiosity_Rover_204\\"></a><strong>Curiosity Rover</strong></h4>\\n<p>To celebrate last weeks incredible MARS landing by the NASA Curiosity Rover, why not check out this video where Pranshu Tople simulates Curiosity using ROS.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/705512250f5e46b3a59160c17ca48274_Simulating%20Curiosity%20Rover%20using%20ROS%20%EF%BD%9C%EF%BD%9C%20Aiming%20to%20be%20NASA%20Engineer%20-%20Learn%20to%20Code%20Mars%20Rover%21.mp4\\" controls=\\"controls\\"></video></p>\\n<p>If you feel excited by that, why not check out the Amazon Web Services RoboMaker workshop that was run last year with <a href=\\"https://aws-oss.beachgeek.co.uk/7m\\" target=\\"_blank\\">JPL Open Source Rover challenge</a>.</p>\\n<h4><a id=\\"Prometheus_and_Grafana_212\\"></a>Prometheus and Grafana</h4>\\n<p>Another great session from the Containers from the Couch team, together with guests Jaana Dogan, Alolita Sharma, and Imaya Jagannathan that show you how you can monitor container workloads with Amazon Managed Service for Prometheus and Grafana.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/e42fcf4adcb944c6966cf6cd5bf79331_Monitoring%20container%20workloads%20with%20Amazon%20Managed%20Service%20for%20Prometheus%20and%20Grafana.mp4\\" controls=\\"controls\\"></video></p>\\n<h3><a id=\\"Quick_updates_219\\"></a><strong>Quick updates</strong></h3>\\n<h4><a id=\\"Kubernetes_220\\"></a><strong>Kubernetes</strong></h4>\\n<ul>\\n<li>Amazon EKS and EKS Distro now supports Kubernetes version 1.19. Kubernetes is rapidly evolving, with frequent feature releases and bug fixes. Highlights of the Kubernetes 1.19 release include Ingress API and Pod Topology Spread reaching stable status, EndpointSlices being enabled by default, and immutable Secrets and ConfigMaps.</li>\n<li>Kubernetes version 1.15 will no longer be supported on May 3rd, 2021. <a href=\\"https://aws.amazon.com/about-aws/whats-new/2021/02/amazon-eks-supports-kubernetes-version-1-19/\\" target=\\"_blank\\">Read more here</a>.</li>\\n</ul>\n<h4><a id=\\"Flutter_225\\"></a><strong>Flutter</strong></h4>\\n<p>Flutter support in Amazon Web Services Amplify is now generally available (GA). Amplify is a set of tools and services that help frontend web and mobile developers build secure, scalable, full-stack applications. Flutter is an open-source UI software development kit created by Google for developing applications for Android and iOS from a single codebase. Amplify Flutter brings together Amplify and Flutter. It is designed for developers who have invested in the Flutter ecosystem and now want to take advantage of the power of Amazon Web Services. You can use the Amplify Flutter libraries with Amplify-created backends, as well as existing Amazon Web Services backends.</p>\n<p>Compared to the initial Developer Preview, the GA release adds Data, API, and Auth capabilities. Amplify DataStore, now supported in Amplify Flutter, provides a local programming model that makes working with distributed, cross-user data as simple as working with local-only data. No additional code is required for offline and online scenarios. Amplify Flutter’s new API capabilities provide clients for making signed HTTP requests to both GraphQL and REST endpoints. Finally, today’s GA release adds support for authenticating app users using Hosted UI. Hosted UI is a customizable OAuth 2.0 flow that allows developers to launch a login screen without embedding the SDK for Cognito or a social provider—such as Facebook, Google, and Amazon—in your application.</p>\n<h4><a id=\\"Elasticsearch_231\\"></a><strong>Elasticsearch</strong></h4>\\n<p>Amazon Elasticsearch Service adds Trace Analytics, a new feature for distributed tracing that enables developers and IT operators to find and fix performance problems in distributed applications, leading to faster problem resolution times.</p>\n<p>Trace Analytics enables developers and IT Ops to troubleshoot performance and availability issues in their distributed applications, giving them end-to-end insights not possible with traditional methods of collecting logs and metrics from each component and service individually. By adding trace data to the existing log analytics capabilities of Amazon Elasticsearch Service, customers can use the same service to both isolate the source of performance problems and diagnose their root cause. Trace Analytics supports OpenTelemetry, a Cloud Native Computing Foundation (CNCF) project which provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics, enabling customers to leverage Trace Analytics without having to re-instrument they applications.</p>\n<p>Trace Analytics today supports collection of trace data from application libraries and SDK’s that are compatible with the open source OpenTelemetry Collector, including OpenTelemetry SDKs, X-Ray SDKs, Jaeger and Zipkin SDKs. Trace Analytics also integrates with Amazon Web Services Distro for OpenTelemetry, which is a distribution of OpenTelemetry APIs, SDKs, and agents/collectors. It is a performant and secure distribution of OpenTelemetry supported by Amazon Web Services. Customers can use Amazon Web Services Distro for OpenTelemetry to collect traces and metrics for multiple monitoring solutions, including Amazon Elasticsearch Service and Amazon Web Services X-Ray for trace data, and Amazon CloudWatch for metrics. For more information on configuring and using Trace Analytics, please see documentation.</p>\n<h3><a id=\\"Stay_in_touch_with_open_source_at_Amazon_Web_Services_239\\"></a><strong>Stay in touch with open source at Amazon Web Services</strong></h3>\\n<p>I hope this summary has been useful. Remember to check out the <a href=\\"https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&amp;opensource-all.sort-order=asc\\" target=\\"_blank\\">Open Source homepage</a> to keep up to date with all our activity in open source by following us on <a href=\\"https://twitter.com/AWSOpen\\" target=\\"_blank\\">@AWSOpen</a>.</p>\n"}