Amazon Web Services

From InterSciWiki
(Redirected from AWS)
Jump to: navigation, search

--AWS-- Garr - Lopez - Nilsson - Henry - Mangalam - Welcome to HPC at UCI / OIT -- High Performance Computing Cluster Office of Information Technology - Joseph A. Farran: HPC LEAD, HPC Architect Expert & Sys Admin - Harry J. Mangalam: HPC Data Storage Expert & Sys Admin - Garr E. Updegraff: DB Expert & Part-time Sys Admin]


AWS galaxy instance

Rmodel      coef	stdcoef	VIF hcpval  bootpval star	Dependent var='v235': Mean Size Local Communities				
(Intercept) 5.3989	NA       NA     0.0000	0.0000	***	(Intercept)			
v1 -------- 0.5803	0.3114	1.0922	0.0000	0.0000	***	Intercommunity Trade as Food Source				
v3 -------- 0.7277	0.5740	1.1419	0.0000	0.0000	***	Agriculture- Contribution to Local Food Supply				
Wy -------- 1.0216	0.2655	1.1337	0.0000	0.0000	***	Network lag term

Hi Doug

  • Matt Paulin (cc'd) is a friend of mine who has a software consulting company who may be able to help you move your academic web site to AWS or another location where it can be maintained indefinitely. Assuming you are still interested in moving forward on that, I'd suggest setting up a call and you two can discuss more in depth.

&best, Scott White

Phone call Eric Stu Dao Jon - Garr E. Updegraff <garru@uci.edu>

Queries for Jon: could you comment or make suggestions? what means java 'dbean libraries'?

HM=Harry Mangalam AWS Francisco Lopez - jaz on XSEDE - backend remove job submitter - UCI or XSEDE class in China - also BNlearn - centOS --- CentOS wiki --- dbean libraries(?) - depth - port not continued - HM=Harry - to what extent are we submitting jobs (to:) XSEDE is a requirement - if Carly(?) does work that Eric has operated - HB: Comet - problem is dataset is on Comet - Eric - data - not large - might be minimal - --- egress AMAZON Amazon Elastic Compute Cloud (Amazon EC2) provides scalable computing capacity in the Amazon Web Services (AWS) cloud. Using Amazon EC2 eliminates your need to invest in hardware up front, so you can develop and deploy applications faster. You can use Amazon EC2 to launch as many or as few virtual servers as you need, configure security and networking, and manage storage --- getting friendly for universities - Scenic network - no cost - free at Amazon. If allocation spins up a cluster, worth it -- is it worth it for cloudman? - Eric - not updated from Comet - Paul has a newer version. Good news: can up-data on comet itself,replace the file itself - how one does that? Reference point. Simple update code. Paul - will support it - we'll pay for that human? What UCI manpower needs are.

Jon: there's a way to setup as a VM on comet (Eric): schedule with course - if you want ad-hoc... Gateway - jobs to compute ... 2 ways: run on portal post or submit to Comet ... Portal on UCI system - minimal - all go to Comet - run on Amazon - local exec ... larger instance 2 - cloudman - HB: --- HPC system here at UCI --- additional instances - remote execution call. HB preference is upgrade local instance - web front end - posts HPCs or Comet - can arrange scheduler, lead time on the class.

GARR Garr Updegraff <garru@uci.edu> + 1 Undegrad research computing research support bioinformtaic already - SGE - modification at SDSC runs slush. Written document (Eric) --> will write this. Techical contact - Nancy Wilkins-Diehr. Send to Harry. UCI is the VM. Operations. --- Globus separate --- Stu - lots of universities installing - HB main file transfer... ... distributed --- adding parts of that -- lately - globus sas - sharing - sharing of data - distributed and shared data. TALK TO HM. Groups. Globus OFF - XSEDE DOING THIS, can outsource that -- beside the... - integrate - portal - API - 160 chunks too complex. For integration - can be daunting. RPMS linux rpms toolkit - SAS not there. Sharing stuff -, your users have accounts - at your system thru unix. At UCI - when sharing - delegate to them directly without them having accounts !! outsourcing integration for direct accounts. Globus is a multiconnect (transfer). Not trivial - lots of time and pain. Has been codified.

Dao
Jon
Document from  Eric - 
XSEDE applications to Comet - if it (Xsede?) runs at UCI - part of the gateway - only certain users able to run - in gateway ... 
New Business - Eric writing Doc. this week. Will send to me -- Paul, Harry.
Report - then handoff to Harry Mangalam can he ask you - Eric would deal with it... a.s.a.p.
Eric is the person to ask in near term ... not a whole lot on time on i...  can answer questions occassionally. 

LESSONS TO LEARN : Netflix site - http://aws.amazon.com/products/?scicountry=en&sc_ichannel=ha&sc_isegment=2&sc_idetail=ha_en_72&sc_icontent=ha_en_1&sc_icampaigntype=3&sc_ipage=homepage&sc_iplace=ha_en_ed&sc_icampaign=ha_en_WhatIsAWS&trkCampaign=&trk=/

 Harry Mangalam 1 (949)-285-4487 ; 858-824-6345 Dao Vuong    ---   Jonathan Nilsson 949-824-1536   AWS   Duncan Phipps  
 Francisco Lopez Lopez  1 949 824-8818, researcher for galaxy HPC but might not work    user comment line  R library    OIT  Eric Stu    hpc 
Summary of the CloudMan architecture 
No need for an external broker 
Automated configuration 
Minimum setup time and cost 
Data persistence 
Built-in support for managing the oscillating data volume 
Customizable instances: CloudMan as PaaS 
Versioning of tools, data, and configurations 
Comments317
Jonathan email to Stephen at UCI
The AWS Cloudman Galaxy instance is running at this URL
http://ec2-54-209-170-18.compute-1.amazonaws.com/cloud/
username: ubuntu
password: C0SSciGuardians (the second character is a 'zero')
You can use the same credentials to SSH to the server:
ssh ubuntu@ec2-54-209-170-18.compute-1.amazonaws.com
Best, Jonathan Leung-Nilsson

Dao: AWC account: 081199430569

Amazon Web Services free for first year -- http://www.nih.gov/news-events/news-releases/1000-genomes-project-data-available-amazon-cloud 1000-Genomes Project sits on AWC

alternatives | Digital Ocean | Rackspace | Clouder / Slicehost /

AWS account

After creating your AWS account you can use any of the 21 products and services, listed below, for free within certain usage limits.

Enter your billing address and credit card information. You will not be charged unless your usage exceeds the free usage tiers.

Featured Products icon: aws-icons_06_amazon-ec2

AWS - EC2

Amazon EC2 Resizable compute capacity in the Cloud. Learn More » 750 hours per month of Linux, RHEL, or SLES t2.micro instance usage 750 hours per month of Windows t2.micro instance usage

Run one instance at a time or multiple instances simultaneously
aws-icons_15_amazon-s3

Amazon S3

Highly scalable, reliable, and low-latency data storage infrastructure. Learn More » 5 GB of Standard Storage 20,000 Get Requests 2,000 Put Requests

aws-icons_10_amazon-dynamodb

Amazon DynamoDB Fast and flexible NoSQL database with seamless scalability. Learn More » 25 GB of Storage 25 Units of Write Capacity 25 Units of Read Capacity

Enough to handle up to 200M requests per month
aws_lambda_free_tier

AWS Lambda New AWS Free Tier Offer Compute service that runs your code in response to events and automatically manages the compute resources Learn More » 1,000,000 free requests per month Up to 3.2 million seconds of compute time per month

icon_key-management-service

AWS Key Management Service New AWS Free Tier Offer AWS Key Management Service is a managed service that provides easy encryption with administrative controls. Learn More »

Email from ECS

AWS Webinar Series - New Services

Join our October webinar series to learn about the new services and features just announced at AWS re:Invent.

These webinars feature technical sessions led by AWS solutions architects, product managers, and engineers, live demonstrations, and Q&A with AWS experts.

IoT: Learn how to easily and securely connect devices to the cloud with AWS IoT.

Analytics:

   Learn how Business Intelligence can be fast, easy to use and scalable with Amazon QuickSight.
   Learn how to easily load streaming data into Amazon S3 and Amazon Redshift using Amazon Kinesis Firehose.
   Learn how to run Elasticsearch clusters on AWS with Amazon Elasticsearch Service.

Mobile: Learn about AWS Mobile Hub, the fastest way to build mobile apps on AWS.

Compute:

   Learn how to schedule, version and use Python with your AWS Lambda functions.
   Learn a new way to use Amazon EC2 at up to 90% less than EC2 On Demand prices. 

Data Transfer: Learn about AWS Import / Export Snowball, a fast, secure, petabyte-scale data transport service.

Security: Learn how you can use AWS WAF to provide firewall protection for your web applications.

We look forward to having you with us!

Register Now →

Thank you, The Amazon Web Services Team Visit our website to learn more »


We hope you enjoyed receiving this message. If you'd rather not receive future emails from Amazon Web Services, unsubscribe here.

Amazon Web Services, Inc. is a subsidiary of Amazon.com, Inc. Amazon.com is a registered trademark of Amazon.com, Inc. This message produced and distributed by Amazon Web Services, Inc., 410 Terry Ave. North, Seattle, WA 98109-5210.

2016

Amazon Web Services AWS re:Invent 2016 Registration is Now Open

Register now for the fifth annual AWS re:Invent, the largest gathering of the global cloud computing community. Join us in Las Vegas for opportunities to connect, collaborate, and learn about AWS solutions. This year we are offering all-new technical deep-dives on topics such as IoT, serverless computing, security, and containers. We are also delivering more than 400 sessions, more hands-on labs, bootcamps, and opportunities for one-on-one engagements with AWS experts.

Date: November 28 – December 2, 2016 Location: The Venetian, The Mirage, The Encore in Las Vegas, NV Full Conference Pass: $1,599 Learn More and Register » Public Sector Pre-Day Track on November 28 New in 2016 are half-day tracks designed for IT professionals and developers from a variety of industries, including the public sector. You are invited to attend the World Wide Public Sector (WWPS) Pre-Day on Monday, November 28, from 1:00pm - 6:00pm. During this time, AWS engineers will demonstrate how customers in government, education and nonprofits are using AWS to innovate and further their philanthropic missions. In addition, you will hear how WWPS customers are using the cloud to find cures for diseases, transform education, pave the way for governments to change how they interact with citizens, and tackle complex compliance and security requirements.


What you'll gain from attending AWS re:Invent 2016:

   Exciting new products, services, and other reveals in the Keynote and State of the Union sessions.
   In-depth technical information across hundreds of breakout sessions.
   Guidance on AWS services and features, straight from AWS engineers, architects, and partners.
   Master new skills with technical bootcamps, hands-on workshops, and onsite AWS certification exams.
   New technical tracks focusing on hot topics, such as containers, serverless computing, and IoT.
   Industry-specific deep dives, focusing on using AWS in financial services, healthcare, life sciences, government, and digital media.
   Celebrate with the AWS community at our after-hours activities, including the re:Play party, Tatonka atomic wings competition, a pub crawl, and new this year, a 5k run.


Register now and take advantage of great rates at The Venetian | Palazzo, The Mirage, and the Wynn | Encore. In addition, check out the discounts on domestic and international flights from Delta Air Lines – our preferred global airline. Learn more »

Need help justifying your AWS re:Invent trip to your manager? Use our justification email template.

Stay connected: Join the conversation on Twitter using #reInvent and follow @AWSreInvent for news and updates.

We look forward to seeing you in November!

Best regards,


AWS re:Invent Team

P.S. Interested in sponsorship opportunities at AWS re:Invent 2016? Reach out to us here.

If you need support or have questions, please review the FAQ page or contact us at: awsreinvent-support@amazon.com.

Featured Sponsors 2nd Watch Our tested, trusted & proven solutions make the public cloud work better for enterprise businesses. Alert Logic Let Alert Logic manage the security of your AWS environment with 24x7 threat monitoring. Rackspace Rackspace blends tooling and automation plus certified AWS experts to help you get the most from AWS. Trend Micro Inc. Discover turbulence-free cloud security from Trend Micro – elastic protection, accelerated compliance. Amazon Web Services AWS Blog ln brk Facebook LinkedIn Twitter YouTube My Account | Products | Solutions | Pricing | Partners | Documentation | Training | Events & Webinars | AWS Activate | What's New | Blog Not interested in attending AWS re:Invent 2016? Opt-out of receiving this year's AWS re:Invent communications. If you'd rather not receive future emails from Amazon Web Services unsubscribe here. Amazon Web Services, Inc. is a subsidiary of Amazon.com, Inc. Amazon.com is a registered trademark of Amazon.com, Inc. This message was produced and distributed by Amazon Web Services, Inc., 410 Terry Ave. North, Seattle, WA 98109-5210. © 2016, Amazon Web Services, Inc. or its affiliates. All rights reserved. View our privacy policy.