From amy at demarco.com Sun Aug 1 21:14:30 2021 From: amy at demarco.com (Amy Marrich) Date: Sun, 1 Aug 2021 16:14:30 -0500 Subject: [Openinfralabs] Diversity and Inclusion Meeting Reminder - OFTC Message-ID: The Diversity & Inclusion WG invites members of all OIF projects to attend our next meeting Monday Auguat 2nd, at 17:00 UTC in the #openinfra-diversity channel on OFTC. The agenda can be found at https://etherpad.openstack.org/p/ diversity-wg-agenda. Please feel free to add any topics you wish to discuss at the meeting. Thanks, Amy (apotz) -------------- next part -------------- An HTML attachment was scrubbed... URL: From fungi at yuggoth.org Mon Aug 2 15:53:55 2021 From: fungi at yuggoth.org (Jeremy Stanley) Date: Mon, 2 Aug 2021 15:53:55 +0000 Subject: [Openinfralabs] [jstacy@bu.edu: Re: Telemetry Working Group - Confirmed] Message-ID: <20210802155355.wq7wrbel6hjap3it@yuggoth.org> Forwarding this confirmation to the OILabs ML in case folks missed it. For those unfamiliar with EST (technically EDT right now), that's 13:30 UTC as the meeting start time. See you all there! -- Jeremy Stanley ----- Forwarded message from "Stacy, Jennifer" ----- Date: Mon, 2 Aug 2021 15:39:17 +0000 Good Morning, Just a quick email to confirm the Telemetry Working Group will be meeting as scheduled tomorrow (Tuesday August 3 at 9:30AM EST). The topics to be covered tomorrow include 1.) research ideas and 2.) anomaly detection for logs. Please let me know if you have any questions. Best, Jen Jennifer Stacy Associate Director Mass Open Cloud Red Hat Collaboratory at Boston University Rafik B. Hariri Institute for Computing and Computational Science & Engineering Boston University C: (781) 308-1730 From: jstacy at bu.edu When: 9:30 AM - 10:30 AM August 3, 2021 Subject: Telemetry Working Group - Regular Monthly Location: https://bostonu.zoom.us/j/92042192235?pwd=VktYcktHRWphdDVvam84NjF5Tmo1QT09 Please note we are updating this meeting to be held monthly (instead of biweekly) The recurring Zoom information for this meeting is: https://bostonu.zoom.us/j/92042192235?pwd=VktYcktHRWphdDVvam84NjF5Tmo1QT09 or use Meeting ID: 920 4219 2235, Passcode: 045484. Currently, the charter, agendas and meeting notes can be found here. Zoom Info Jennifer Stacy is inviting you to a scheduled Zoom meeting. Join Zoom Meeting https://bostonu.zoom.us/j/92042192235?pwd=VktYcktHRWphdDVvam84NjF5Tmo1QT09 Meeting ID: 920 4219 2235 Passcode: 045484 One tap mobile +13017158592,,92042192235# US (Washington D.C) +13126266799,,92042192235# US (Chicago) Dial by your location +1 301 715 8592 US (Washington D.C) +1 312 626 6799 US (Chicago) +1 646 876 9923 US (New York) +1 253 215 8782 US (Tacoma) +1 346 248 7799 US (Houston) +1 669 900 6833 US (San Jose) Meeting ID: 920 4219 2235 Find your local number: https://bostonu.zoom.us/u/abtatg6BIx Join by SIP 92042192235 at zoomcrc.com Join by H.323 162.255.37.11 (US West) 162.255.36.11 (US East) 221.122.88.195 (China) 115.114.131.7 (India Mumbai) 115.114.115.7 (India Hyderabad) 213.19.144.110 (Amsterdam Netherlands) 213.244.140.110 (Germany) 103.122.166.55 (Australia) 209.9.211.110 (Hong Kong SAR) 64.211.144.160 (Brazil) 69.174.57.160 (Canada) 207.226.132.110 (Japan) Meeting ID: 920 4219 2235 Passcode: 045484 Join by Skype for Business https://bostonu.zoom.us/skype/92042192235 ----- End forwarded message ----- From dr.huilei at gmail.com Wed Aug 4 03:01:53 2021 From: dr.huilei at gmail.com (Hui Lei) Date: Tue, 3 Aug 2021 23:01:53 -0400 Subject: [Openinfralabs] Project Caerus Update Message-ID: Dear all, I would like to take this opportunity to give you another update on Project Caerus. As you may remember, the project develops techniques such as near-data processing and semantic caching to optimize the performance of disaggregated data lakes. On the front of near data processing, we have implemented the pushdown of a wide range of SQL operators from a Spark cluster to a storage cluster that deploys either HDFS (CSV format) or S3. Our evaluation using TCPH has shown significant improvements in application latency, network I/O and compute-side CPU time. You can check out our design document and latest evaluation results in GitHub. On the front of semantic cache, which explores opportune caching of a variety of data and metadata, we have the core functionality working, with 4x-5x improvement in execution time and CPU time. Again the design document and the initial evaluation results are available in GitHub. As always, your comments and contributions are welcome. - Hui -------------- next part -------------- An HTML attachment was scrubbed... URL: From mhild at redhat.com Thu Aug 5 13:03:40 2021 From: mhild at redhat.com (Marcel Hild) Date: Thu, 5 Aug 2021 15:03:40 +0200 Subject: [Openinfralabs] Project Caerus Update In-Reply-To: References: Message-ID: Hey Hui, thanks for the update. Have you considered to implement a running version for your POC to the Operate First Community Cloud at https://www.operate-first.cloud/ ? There's also a spark cluster available and JupyterNotebooks. If the community could try out your work, that might increase the awarnes On Wed, Aug 4, 2021 at 5:02 AM Hui Lei wrote: > Dear all, > > I would like to take this opportunity to give you another update on > Project Caerus. As you may remember, the project develops techniques such > as near-data processing and semantic caching to optimize the performance of > disaggregated data lakes. On the front of near data processing, we have > implemented the pushdown of a wide range of SQL operators from a Spark > cluster to a storage cluster that deploys either HDFS (CSV format) or S3. > Our evaluation using TCPH has shown significant improvements in application > latency, network I/O and compute-side CPU time. You can check out our design > document > > and latest evaluation results > > in GitHub. > > On the front of semantic cache, which explores opportune caching of a > variety of data and metadata, we have the core functionality working, with > 4x-5x improvement in execution time and CPU time. Again the design > document > > and the initial evaluation results > > are available in GitHub. > > As always, your comments and contributions are welcome. > > - Hui > _______________________________________________ > Openinfralabs mailing list > Openinfralabs at lists.opendev.org > http://lists.opendev.org/cgi-bin/mailman/listinfo/openinfralabs > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dr.huilei at gmail.com Thu Aug 5 14:16:30 2021 From: dr.huilei at gmail.com (Hui Lei) Date: Thu, 5 Aug 2021 10:16:30 -0400 Subject: [Openinfralabs] Project Caerus Update In-Reply-To: References: Message-ID: Marcel, This item is already on our backlog. We just haven't been able to get to it. We certainly welcome other community members to join us and help accelerate this item. Hui On Thu, Aug 5, 2021 at 9:04 AM Marcel Hild wrote: > Hey Hui, > thanks for the update. > > Have you considered to implement a running version for your POC to > the Operate First Community Cloud at https://www.operate-first.cloud/ ? > There's also a spark cluster available and JupyterNotebooks. > If the community could try out your work, that might increase the awarnes > > On Wed, Aug 4, 2021 at 5:02 AM Hui Lei wrote: > >> Dear all, >> >> I would like to take this opportunity to give you another update on >> Project Caerus. As you may remember, the project develops techniques such >> as near-data processing and semantic caching to optimize the performance of >> disaggregated data lakes. On the front of near data processing, we have >> implemented the pushdown of a wide range of SQL operators from a Spark >> cluster to a storage cluster that deploys either HDFS (CSV format) or S3. >> Our evaluation using TCPH has shown significant improvements in application >> latency, network I/O and compute-side CPU time. You can check out our design >> document >> >> and latest evaluation results >> >> in GitHub. >> >> On the front of semantic cache, which explores opportune caching of a >> variety of data and metadata, we have the core functionality working, with >> 4x-5x improvement in execution time and CPU time. Again the design >> document >> >> and the initial evaluation results >> >> are available in GitHub. >> >> As always, your comments and contributions are welcome. >> >> - Hui >> _______________________________________________ >> Openinfralabs mailing list >> Openinfralabs at lists.opendev.org >> http://lists.opendev.org/cgi-bin/mailman/listinfo/openinfralabs >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From fungi at yuggoth.org Mon Aug 30 22:12:00 2021 From: fungi at yuggoth.org (Jeremy Stanley) Date: Mon, 30 Aug 2021 22:12:00 +0000 Subject: [Openinfralabs] FWD: Telemetry Working Group Confirmed 2021-08-31 13:30 UTC Message-ID: <20210830221200.iqwqmtlqouzsvwx7@yuggoth.org> See below, the Telemetry Working Group meeting tomorrow (Tuesday, 2021-08-31) at 13:30 UTC (9:30 AM EDT) is still being held. Connection details are included in the forwarded message. See you there! -- Jeremy Stanley ----- Forwarded message from "Stacy, Jennifer" ----- Date: Mon, 30 Aug 2021 22:04:18 +0000 Subject: Telemetry Working Group Confirmed August 31 @ 9:30 AM EST Good Afternoon, Just a quick email to confirm the Telemetry Working Group will be held tomorrow, August 31, 2021 at 9:30 AM EST. The agenda is a presentation and discussion on Storing Logs and Metrics in the Operate First Community Cloud, Anand Sanmukhani. We look forward to seeing you all! Best, Jen From: jstacy at bu.edu When: 9:30 AM - 10:30 AM August 31, 2021 Subject: Telemetry Working Group - Regular Monthly Location: https://bostonu.zoom.us/j/92042192235?pwd=VktYcktHRWphdDVvam84NjF5Tmo1QT09 Please note we are updating this meeting to be held monthly (instead of biweekly) The recurring Zoom information for this meeting is: https://bostonu.zoom.us/j/92042192235?pwd=VktYcktHRWphdDVvam84NjF5Tmo1QT09 or use Meeting ID: 920 4219 2235, Passcode: 045484. Currently, the charter, agendas and meeting notes can be found here. Zoom Info Jennifer Stacy is inviting you to a scheduled Zoom meeting. Join Zoom Meeting https://bostonu.zoom.us/j/92042192235?pwd=VktYcktHRWphdDVvam84NjF5Tmo1QT09 Meeting ID: 920 4219 2235 Passcode: 045484 One tap mobile +13017158592,,92042192235# US (Washington D.C) +13126266799,,92042192235# US (Chicago) Dial by your location +1 301 715 8592 US (Washington D.C) +1 312 626 6799 US (Chicago) +1 646 876 9923 US (New York) +1 253 215 8782 US (Tacoma) +1 346 248 7799 US (Houston) +1 669 900 6833 US (San Jose) Meeting ID: 920 4219 2235 Find your local number: https://bostonu.zoom.us/u/abtatg6BIx Join by SIP 92042192235 at zoomcrc.com Join by H.323 162.255.37.11 (US West) 162.255.36.11 (US East) 221.122.88.195 (China) 115.114.131.7 (India Mumbai) 115.114.115.7 (India Hyderabad) 213.19.144.110 (Amsterdam Netherlands) 213.244.140.110 (Germany) 103.122.166.55 (Australia) 209.9.211.110 (Hong Kong SAR) 64.211.144.160 (Brazil) 69.174.57.160 (Canada) 207.226.132.110 (Japan) Meeting ID: 920 4219 2235 Passcode: 045484 Join by Skype for Business https://bostonu.zoom.us/skype/92042192235 ----- End forwarded message -----