p03n1x

CSC 8710 Final Project part three

Project Part - 2 | CSC8710 | Tarun Marwaha | Dathri Yeddula

Low-time complexity budget–deadline constrained workflow scheduling on heterogeneous resources

Project Proposal - 1 | CSC8710 | Tarun Marwaha | Dathri Yeddula

In this exercise, you will create and run RA workflows using DATAVIEW that are described below. You will watch this tutorial before your exercise: https://rumble.com/vcy2f9-ep6-how-to-create-a-relational-algebra-workflow-via-the-dataview-website.html (Links to an external site.) Professor(ssn, profname, status) Course(crscode, crsname,credits) Taught(crscode,semester,ssn) Please note that port 1 of a SELECT task needs to be connected to a table and port 2 of the task needs to be connected to a SELECT condition. Similarly, port 1 of a PROJECT task needs to be connected to a table and port 2 of the task needs to be connected to a column list. Port 1 of the Rename task needs to be connected to a table and port 2 of the Rename task needs to be connected to a renaming list in the form of NewColName:OldColName,NewColName:OldColName. Workflow 1. Begin with a table of each Natural join Professor with Taught. This will be referred to as table C Natural join table C with Course. This will be referred to as Table D Select table D with profname == “Lu”( new String("profname == \"Lu\"");) as E Project crscode,credits onto Table E as Table F Rename crscode to class_number(class_number:crscode) onto Table F Workflow 2. Begin with a table of course and taught Rename crscode to class_number(class_number:crscode) Natural Join course and taught. This table will be referred to as table C moving forward Natural Join the original Course and Taught tables. This will be referred to as D. Project C with crsname,credits,class_number,semester,ssn Rename crscode to class_number in table D. Note that port 1 of the Rename task needs to be connected to a table and port 2 of the Rename task needs to be connected to a renaming list in the form of NewColName:OldColName,NewColName:OldColName. Set difference C and D. Convert the RA expressions for Queries 1-4 from slide 91 of chapter5.pptxPreview the document to the corresponding workflows and run them in DATAVIEW. Please notice that the codes with red fonts are your input string. E.g. wins[3] = new String("profname == \"Lu\"");

Paper 3: Ming Mao and Marty Humphrey. 2013. Scaling and scheduling to maximize application performance within budget constraints in cloud workflows. In Proceedings of the International Parallel & Distributed Processing Symposium (IPDPS'13). IEEE, 67-78.

In this exercise, you will set up DATAVIEW and run a sample workflow in Amazon EC2.

In this exercise, you will download and install DATAVIEW and run it as a Web site.

Exercise 1: Download DATAVIEW and run a sample workflow 1) Learn how to use Github with Eclipse from this youtube video: How To Add Eclipse Project To GitHub | How to Commit, Push, Pull from Eclipse to GitHub (Links to an external site.) How To Add Eclipse Project To GitHub | How to Commit, Push, Pull from Eclipse to GitHub 2). Download the DATAVIEW system V2.2 (from Release DATAVIEW Release 2.2 · shiyonglu/DATAVIEW · GitHub (Links to an external site.)) and run an example of a workflow by following the readme file and this tutorial: https://youtu.be/B8hMId13ANA (Links to an external site.)