Cited By
View all- Jovanovic PSimitsis AWilkinson K(2014)Engine independence for logical analytic flows2014 IEEE 30th International Conference on Data Engineering10.1109/ICDE.2014.6816723(1060-1071)Online publication date: Mar-2014
The farm: where pig scripts are bred and raised
Authors: 
Craig P. Sayers, 
Alkis Simitsis, Georgia Koutrika, Alejandro Guerrero Gonzalez, David Tamez Cantu, Meichun HsuAuthors Info & Claims
Craig P. Sayers, Alkis Simitsis, Georgia Koutrika, Alejandro Guerrero Gonzalez, David Tamez Cantu, Meichun HsuAuthors Info & ClaimsPages 1025 - 1028
Abstract
Even though scripting languages like Pig allow for simpler coding, performing analytics over Big Data using Map-Reduce engines remains challenging. To further assist developers, and support novice users, we offer "The Farm", a catalog of scriptable services supporting creation, discovery, composition, and optimized execution. Each Pig script added to The Farm becomes an executable service, with inputs and outputs defined by relation schemas. Those services are discoverable using natural language search, and composable using a drag-and-drop interface. To support efficient execution, composed services are automatically merged to a single executable script, which can then be run by a growing selection of platform-specific optimizers and interpreters.
References
[1]
Apache Pig. url: http://pig.apache.org/.
[2]
G. Koutrika and A. Simitsis. Mirror mirror on the wall, what is the fairest query of them all? In CIDR, 2013.
[3]
G. Koutrika, A. Simitsis, and Y. E. Ioannidis. Explaining structured queries in natural language. In ICDE.
[4]
T. Lethbridge, J. Singer, and A. Forward. How software engineers use documentation: The state of the practice. IEEE Software, 2003.
[5]
A. Simitsis, K. Wilkinson, M. Castellanos, and U. Dayal. Optimizing analytic data flows for multiple execution engines. In SIGMOD, 2012.
[6]
A. Simitsis, K. Wilkinson, U. Dayal, and M. Hsu. HFMS: Managing the lifecycle and complexity of hybrid analytic data flows. In ICDE, 2013.
[7]
S. Thummalapenta and T. Xie. Parseweb: A programmer assistant for reusing open source code on the web. In ASE, 2007.
Index Terms
- The farm: where pig scripts are bred and raised
Recommendations
Cost Minimization and Load Balancing Issues to Compose Web Services in a Multi Cloud Environment
IPAC '15: Proceedings of the International Conference on Intelligent Information Processing, Security and Advanced CommunicationThe Web services composition can be defined as a process where component services are identified and the dependencies between them are also described. The reusability of the independent components for different compositions gives flexibility. In a multi ...
Combining horizontal and vertical composition of services
Service composition is a well-established field of research in the service community. Services are commonly regarded as black boxes with well-defined interfaces that can be recursively aggregated into new services. The black-box nature of services does ...
Web services discovery and constraints composition
RR'07: Proceedings of the 1st international conference on Web reasoning and rule systemsThe most promising feature of the Web services platform is its ability to form new (composite) services by combining the capabilities of already existing (component) services. The existing services may themselves be composite leading to a hierarchical ...
Comments
Information & Contributors
Information
Published In
June 2013
1322 pages
ISBN:9781450320375
DOI:10.1145/2463676
- General Chairs:
- Kenneth Ross,
- Divesh Srivastava,
- Program Chair:
- Dimitris Papadias
Copyright © 2013 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 June 2013
Check for updates
Author Tags
Qualifiers
- Demonstration
Conference
SIGMOD/PODS'13
Sponsor:
SIGMOD/PODS'13: International Conference on Management of Data
June 22 - 27, 2013
New York, New York, USA
Acceptance Rates
SIGMOD '13 Paper Acceptance Rate 76 of 372 submissions, 20%;
Overall Acceptance Rate 785 of 4,003 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 318Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)2
Reflects downloads up to 05 Feb 2025
Other Metrics
Citations
Cited By
View all- Jovanovic PSimitsis AWilkinson K(2014)Engine independence for logical analytic flows2014 IEEE 30th International Conference on Data Engineering10.1109/ICDE.2014.6816723(1060-1071)Online publication date: Mar-2014
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in