bash实现线程池,动态分析页面

2024-01-03 09:58

本文主要是介绍bash实现线程池,动态分析页面,希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

#总结来说,bash实现方便但是没有锁,是的实现过于晦涩,打算使用python改写之


#!/bin/bashdeclare -a SDM=($@) #inputdeclare -a printArray=() #no use nowdeclare -a printKey=() #avoid dead circledeclare -a thread_pid=() #multhreadexport threadNum=30export bexistFlag=0export filename="$1.status.txt"export tempsubdir="$1.subdir"export mtfilename="$tempsubdir/$1.status"export dbfilename="$tempsubdir/$1.debug"export begin_time=""export end_time=""function fetch(){ for loop in $@ do for loop1 in ${printKey[@]} do if [ "$loop1" = "$loop" ];then bexistFlag=1 break fi done if [ "$bexistFlag" = "1" ];then bexistFlag=0 continue fi#rm -fr ${tempsubdir}/${loop}.txt if [ ! -e ${tempsubdir}/${loop}.txt ];then curl -s -u tailianl:1qazxsw@ https://atlassianwave.web.alcatel-lucent.com/jira/browse/${loop} -o ${tempsubdir}/${loop}.txt elif [ -s ${tempsubdir}/${loop}.txt ];then echo "${loop}.txt exist once" >> ${dbfilename}.$! sleep 1 else echo "${tempsubdir}/${loop}.txt size is 0" >> ${dbfilename}.$! while [ 1 ]; do if [ -s ${tempsubdir}/${loop}.txt ];then echo "${loop}.txt wait for done" >> ${dbfilename}.$! sleep 1 break else echo "${loop}.txt wait for exist" >> ${dbfilename}.$! sleep 1 fi done fi # echo ""echo -n "---$loop---" echo "----------------------$loop----------------------------" >>${dbfilename}.$! #linkJira=`cat ${loop}.txt | grep "data-issue-key" | grep -v "div" | awk -F= '{print $3}' | awk '{print $1}' | awk '{print $1}'|sort -u|awk -F\" '{print $2}'|grep SDM` checkVliad priority=`cat ${tempsubdir}/${loop}.txt | grep priorities | grep -v class | awk '{print $2}' | awk -F= '{print $2}'|awk -F\" '{print $2}'` isfixed=`cat ${tempsubdir}/${loop}.txt | grep fixforversion | awk -F">" '{print $2}' | awk -F"<" '{print $1}'` firstStatus=`cat ${tempsubdir}/${loop}.txt | grep -n "jira-issue-status-lozenge" | awk '{print $1}'` nowVersion $firstStatus theStatus=`cat ${tempsubdir}/${loop}.txt | grep -n jira-issue-status-lozenge | grep "$theVersion" | awk -F\> '{print $2}'|awk -F\< '{print $1}'` printKey=(${printKey[@]} $loop) #echo ${printKey[@]} printArray=(${printArray[@]} "$loop $priority $isfixed") if [ "$isfixed" != "" ];then #printf "%-10s%-10s%-15s%10s\n" $loop $isfixed $theStatus $priority >> status.txt echo "$lline#$loop#$isfixed#$theStatus#$priority" >> $mtfilename.$! fetch $linkJira fi done return 0}function checkVliad(){#echo $@ declare -a numDuplicate=(`cat ${tempsubdir}/${loop}.txt | grep -n "dt title"| grep -i duplicate|awk -F: '{print $1}'`)#echo $numDuplicate if [ ${#numDuplicate[@]} -eq 0 ];then linkJira=`cat ${tempsubdir}/${loop}.txt | grep "data-issue-key" | grep -v "div" |grep SDM| grep issue-link | grep link-title| awk -F= '{print $3}' | awk '{print $1}' | awk '{print $1}'|sort -u|awk -F\" '{print $2}'` echo "linkJira: $linkJira" >> ${dbfilename}.$! else declare -a checkDuplite=(`cat ${tempsubdir}/${loop}.txt| grep -n "dt title" | awk -F: '{print $1}'`) uplevel=20000 downlevel=0#echo ${#checkDuplite[@]}# echo ${checkDuplite[@]} for (( j=0; j < ${#numDuplicate[@]}; j++ )) do for (( i=0; i < ${#checkDuplite[@]}; i++ )) do# echo ${numDuplicate[$j]} ${checkDuplite[$i]} if [ ${numDuplicate[$j]} -ge ${checkDuplite[$i]} ];then downlevel=${checkDuplite[$i]} # echo "downlevel=${checkDuplite[$i]}" fi if [ ${numDuplicate[$j]} -lt ${checkDuplite[$i]} ];then uplevel=${checkDuplite[$i]}# echo "uplevel=${checkDuplite[$i]}" break fi done done declare -a linkJiraIndex=(`cat ${tempsubdir}/${loop}.txt |grep -n "data-issue-key" | grep -v div | grep SDM| grep issue-link | grep link-title|awk -F: '{print $1}'`) declare -a linkJiraTmp=(`cat ${tempsubdir}/${loop}.txt | grep "data-issue-key" | grep -v "div" |grep issue-link | grep link-title|grep SDM| awk -F= '{print $3}' | awk '{print $1}' | awk '{print $1}'|awk -F\" '{print $2}'`) j=0# echo "$downlevel $uplevel" linkJira=""# echo ${linkJiraIndex[@]}# echo ${linkJiraTmp[@]}# echo $downlevel $uplevel for loop4 in ${linkJiraIndex[@]} do# echo $j if [ $loop4 -lt $downlevel -o $loop4 -gt $uplevel ];then # echo $downlevel $loop4 $uplevel linkJira="${linkJiraTmp[$j]} $linkJira" fi ((++j)) done echo "this is duplicate Jira:---" >> ${dbfilename}.$! echo "down and up: $downlevel $uplevel" >> ${dbfilename}.$! echo "linkJiraIndex: ${linkJiraIndex[@]}" >> ${dbfilename}.$! echo "linkJiraTmp: ${linkJiraTmp[@]}" >> ${dbfilename}.$! echo "numDuplicate: ${numDuplicate[@]}" >> ${dbfilename}.$! echo "checkDuplite: ${checkDuplite[@]}" >> ${dbfilename}.$! echo "linkJira: ${linkJira[@]}" >> ${dbfilename}.$! fi return 0}function do_fetch(){ thread_pid=() for loop2 in $@ do for lline in `cat $loop2` do #fetch $lline subprocess $lline printKey=() done done while [ ${#thread_pid[@]} -ne 0 ]; do for pid_idx in ${!thread_pid[*]}; do pid_val=${thread_pid[$pid_idx]} if [ ${#pid_val} -ne 0 ]; then kill -s 0 $pid_val &>/dev/null [ $? -ne 0 ] && unset thread_pid[$pid_idx] fi done done return 0}function nowVersion(){ theVersion=$1 return 0}function formatPrint(){#rm -fr docollect.sh#echo "#!/bin/bash" > docollect.sh#echo "cat ${mtfilename}.* > ${filename}" >> docollect.sh#chmod u+x docollect.sh#echo "please run docollect.sh after analys!!!!!!!!" cat ${mtfilename}.* > ${filename} cat ${dbfilename}.* > ${dbfilename} end_time=`date` echo "end_time: $end_time" >> ${dbfilename} echo "--------------------------------------------" echo "---Begin time: $begin_time" echo "---End time: $end_time" echo "--------------------------------------------" echo "--------------------------------------------" echo "the result file is : ${filename}" echo "the debug file is : ${dbfilename}" echo "--------------------------------------------" return 0}function hello_thread(){ echo "hello" sleep $1 echo "end hello"}function subprocess(){ while [ 1 ]; do if [ ${#thread_pid[@]} -lt ${threadNum} ]; then fetch $1 & #hello_thread 5 & thread_pid=("${thread_pid[@]}" "$!") break else for pid_idx in ${!thread_pid[*]}; do pid_val=${thread_pid[$pid_idx]} if [ ${#pid_val} -ne 0 ]; then kill -s 0 $pid_val &>/dev/null [ $? -ne 0 ] && unset thread_pid[$pid_idx] fi done fi done}function main(){ begin_time=`date` trap "kill -9 $$" SIGINT rm -fr $filename rm -fr $tempsubdir rm -fr $dbfilename mkdir -p $tempsubdir#formatPrint echo "begin_time: $begin_time" > ${dbfilename} do_fetch $@ formatPrint return 0}echo $@main $@

这篇关于bash实现线程池,动态分析页面的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/565325

相关文章

pytorch自动求梯度autograd的实现

《pytorch自动求梯度autograd的实现》autograd是一个自动微分引擎,它可以自动计算张量的梯度,本文主要介绍了pytorch自动求梯度autograd的实现,具有一定的参考价值,感兴趣... autograd是pytorch构建神经网络的核心。在 PyTorch 中,结合以下代码例子,当你

SpringBoot集成Milvus实现数据增删改查功能

《SpringBoot集成Milvus实现数据增删改查功能》milvus支持的语言比较多,支持python,Java,Go,node等开发语言,本文主要介绍如何使用Java语言,采用springboo... 目录1、Milvus基本概念2、添加maven依赖3、配置yml文件4、创建MilvusClient

JS+HTML实现在线图片水印添加工具

《JS+HTML实现在线图片水印添加工具》在社交媒体和内容创作日益频繁的今天,如何保护原创内容、展示品牌身份成了一个不得不面对的问题,本文将实现一个完全基于HTML+CSS构建的现代化图片水印在线工具... 目录概述功能亮点使用方法技术解析延伸思考运行效果项目源码下载总结概述在社交媒体和内容创作日益频繁的

openCV中KNN算法的实现

《openCV中KNN算法的实现》KNN算法是一种简单且常用的分类算法,本文主要介绍了openCV中KNN算法的实现,文中通过示例代码介绍的非常详细,对大家的学习或者工作具有一定的参考学习价值,需要的... 目录KNN算法流程使用OpenCV实现KNNOpenCV 是一个开源的跨平台计算机视觉库,它提供了各

OpenCV图像形态学的实现

《OpenCV图像形态学的实现》本文主要介绍了OpenCV图像形态学的实现,包括腐蚀、膨胀、开运算、闭运算、梯度运算、顶帽运算和黑帽运算,文中通过示例代码介绍的非常详细,需要的朋友们下面随着小编来一起... 目录一、图像形态学简介二、腐蚀(Erosion)1. 原理2. OpenCV 实现三、膨胀China编程(

通过Spring层面进行事务回滚的实现

《通过Spring层面进行事务回滚的实现》本文主要介绍了通过Spring层面进行事务回滚的实现,包括声明式事务和编程式事务,具有一定的参考价值,感兴趣的可以了解一下... 目录声明式事务回滚:1. 基础注解配置2. 指定回滚异常类型3. ​不回滚特殊场景编程式事务回滚:1. ​使用 TransactionT

Android实现打开本地pdf文件的两种方式

《Android实现打开本地pdf文件的两种方式》在现代应用中,PDF格式因其跨平台、稳定性好、展示内容一致等特点,在Android平台上,如何高效地打开本地PDF文件,不仅关系到用户体验,也直接影响... 目录一、项目概述二、相关知识2.1 PDF文件基本概述2.2 android 文件访问与存储权限2.

使用Python实现全能手机虚拟键盘的示例代码

《使用Python实现全能手机虚拟键盘的示例代码》在数字化办公时代,你是否遇到过这样的场景:会议室投影电脑突然键盘失灵、躺在沙发上想远程控制书房电脑、或者需要给长辈远程协助操作?今天我要分享的Pyth... 目录一、项目概述:不止于键盘的远程控制方案1.1 创新价值1.2 技术栈全景二、需求实现步骤一、需求

Spring Shell 命令行实现交互式Shell应用开发

《SpringShell命令行实现交互式Shell应用开发》本文主要介绍了SpringShell命令行实现交互式Shell应用开发,能够帮助开发者快速构建功能丰富的命令行应用程序,具有一定的参考价... 目录引言一、Spring Shell概述二、创建命令类三、命令参数处理四、命令分组与帮助系统五、自定义S

SpringBatch数据写入实现

《SpringBatch数据写入实现》SpringBatch通过ItemWriter接口及其丰富的实现,提供了强大的数据写入能力,本文主要介绍了SpringBatch数据写入实现,具有一定的参考价值,... 目录python引言一、ItemWriter核心概念二、数据库写入实现三、文件写入实现四、多目标写入