林海铭,刘小虎.云环境下的大规模线性有限元并行实现[J].计算力学学报,2017,34(2):197~205 |
| 码上扫一扫! |
云环境下的大规模线性有限元并行实现 |
Parallel implement of large-scale linear elastic FEM in cloud computing environment |
投稿时间:2015-12-20 修订日期:2016-04-25 |
DOI:10.7511/jslx201702011 |
中文关键词: 云计算 SparkRDDs 线性有限元 空间桁架 并行计算 |
英文关键词:cloud computing Spark RDDs linear finite element method spatial truss systems parallel computing |
基金项目:国家自然科学基金(11172110)资助项目 |
|
摘要点击次数: 1654 |
全文下载次数: 1348 |
中文摘要: |
针对Hadoop MapReduce框架实现迭代算法效率不高的问题,提出了基于Spark RDDs(Resilient Distributed Datasets)的大规模线性有限元并行算法,探索在云平台上有效地实现迭代算法。在Hadoop+Spark实验室集群上,通过空间桁架进行算例验证,并与基于Hadoop MapReduce的线性有限元并行算法进行性能比较。结果表明,在本文搭建的集群上,基于RDDs的并行算法能求解15000000个自由度的空间桁架问题,远大于Hadoop平台上的3000000个自由度;对于小模型,Spark可获得200倍以上的加速比,对于大模型,获得7~8倍加速比。 |
英文摘要: |
Considering the fact that iterative algorithm cannot be realized efficiently on Hadoop MapReduce platform, this paper proposed a large-scale finite-element parallel algorithm based on the Resilient Distributed Datasets on the Spark platform in order to explore how to implement iterative algorithm efficiently. The proposed algorithm was then verified using the space truss model on a 6-node Hadoop+Spark platform. Comparisons were made between a performance of Spark-based algorithms and Hadoop-based algorithms of linear elastic FEM. The results indicate that the number of the DOFs of the space truss problem that can be solved by the Spark-based parallel algorithm may reach 15000000, which is much more than that solved by the Hadoop-based parallel algorithm. Obviously, the Spark-based parallel algorithm is preferable. Moreover, the proposed algorithm exhibits an enhanced computing efficiency compared with the Hadoop-based parallel algorithm. Specifically, for a small-scale space truss model, the speed-up ratio reaches 200 while for a large-scale space truss model, it is approximately 7 or 8. |
查看全文 查看/发表评论 下载PDF阅读器 |