image: This is Ang Chen, left, and Eugene Ng. view more
Credit: Jeff Fitlow/Rice University
Rice University scientists have been awarded a National Science Foundation grant to develop distributed programming methods to analyze streaming data.
Computer scientists Ang Chen and Eugene Ng will use a three-year, $1.2 million grant to take advantage of programmable elements in the various components that store and deliver data to customers.
According to Chen, principal investigator on the project, it means the switches, routers and other components that stand between end users and data servers can play a more active part in managing and analyzing big data. It could make data networks faster and more efficient, which would be a boon for financial services, social networks, the "internet of things" and many other applications.
The researchers said the range of programmable elements in data networks has expanded to include not only servers but also interface components, field-programmable gate arrays, application-specific integrated circuits and network topology. "Today, all the processing is done at the server, without any processing or computation along the path. We're going to try to change that," said Ng, a professor of computer science and electrical and computer engineering.
"Our vision is to optimize all of these components to achieve a sweet spot in the design space for each application," said Chen, an assistant professor of computer science and of electrical and computer engineering, who joined Rice in 2017. "We hope to have an approach that can work across different kinds of protocols."
Ng said common examples of streaming data also include fraud detection, monitors and temperature and other environmental sensors that continuously generate data and send it at high speed to servers from all over the world. "Our challenge is to develop a scalable platform that allows programmers to derive real-time insight from data utilizing the technologies we propose," he said.
One likely strategy is to intelligently process and reduce data before it reaches servers, Ng said. That could be accomplished by programming components along the path to handle as much computation as they're able. "That can allow server clusters to pull down more data, because you're not just moving data for the sake of moving it. You're processing it and potentially generating a partial answer to your question.
"I think it's safe to say that there is vast untapped potential in using this emerging hardware for big data processing - and the key word is 'emerging,'" Ng said. "It's new, so very few people have thought about what it can do."
The researchers also plan to study how data flows through networks so they can optimize it on the fly. "Sometimes it matters which stuff you perform first," Chen said. "It's not just about where programming capabilities exist in the network but also about organization of the network itself.
"So we're looking at how an underlying physical network can adapt itself and change the network flow to optimize latency," he said.
###
Read the abstract at https://www.nsf.gov/awardsearch/showAward?AWD_ID=1801884&HistoricalAwards=false.
This news release can be found online at http://news.rice.edu/2018/07/16/scientists-to-tap-data-networks-hidden-powers/
Follow Rice News and Media Relations via Twitter @RiceUNews.
Related materials:
Ang Chen bio: https://www.cs.rice.edu/~angchen/
Eugene Ng bio: https://www.cs.rice.edu/~eugeneng/
Rice Department of Computer Science: https://csweb.rice.edu/
Rice Department of Electrical and Computer Engineering: https://eceweb.rice.edu/
George R. Brown School of Engineering: https://engineering.rice.edu
Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation's top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,970 undergraduates and 2,934 graduate students, Rice's undergraduate student-to-faculty ratio is just under 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for quality of life and for lots of race/class interaction and No. 2 for happiest students by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger's Personal Finance. To read "What they're saying about Rice," go to http://tinyurl.com/RiceUniversityoverview.