diff --git a/.gitignore b/.gitignore new file mode 100644 index 0000000..8b13789 --- /dev/null +++ b/.gitignore @@ -0,0 +1 @@ + diff --git a/_posts/2016-10-28-some-of-my-previews-exper-work.md b/_posts/2016-10-28-some-of-my-previews-exper-work.md index 5e15d92..da63719 100644 --- a/_posts/2016-10-28-some-of-my-previews-exper-work.md +++ b/_posts/2016-10-28-some-of-my-previews-exper-work.md @@ -24,4 +24,39 @@ But we also need some bash script to collect data through different size of rand ### Time Experiment of seafile +Patch is based on seafile 5.1.4. You can find the release from [seafile official repo](https://github.com/haiwen/seafile/releases). You may follow official compile instructions from [here](https://manual.seafile.com/build_seafile/linux.html). \[[Patch]()\] + +#### How to collect data + +We also need everything be done using scripting. But this time I only design added some distance between two increasing files' sizes. + +- Start from 8K to 16M, 4 times increasing, modify at beginning/ at 1024 different places with python script. \[[Bash Script](/static/2016-11/seafile/trans.sh)\|[Python program](/static/2016-11/seafile/addbyte.py)\] +- After using this auto testing script, everything of output will be marked in log files of seafile, which located in **~/.ccnet/log/seafile.log** +- We need to use this simple awk code and vim operation to extract data. + +~~~~bash +# CDC: content defined chucks +# HUT: Http upload traffic +# ALL: overall time of one commit & upload +awk '/CDC|HUT|ALL/ {print $4,$5}' ~/.ccnet/log/seafile.log > results.stat +~~~~ + + +#### Install Seafile on odroid xu + +Due to failure of my cross-compile to seafile on android. I used develop board as a replacement experiment platform for ARM-seafile testing. I used a [odroid xu](http://www.hardkernel.com/main/products/prdt_info.php?g_code=G137510300620) as hardware standard. Because all I need is an ARM platform, only an ARM-Ubuntu is enough for me. But develop prototype on a board is much fun than coding, I won't address much this time. But I'll start a blog telling some really cool stuff I made for a strange aim. + +To install a ubuntu with GUI is my all preparation work. I found to way to do this. + +- [armhf](http://www.armhf.com/boards/odroid-xu/) is a website for arm-based ubuntu. It has a detailed instruction to follow at [here](http://www.armhf.com/boards/odroid-xu/odroid-sd-install/). They also provide ubuntu 12.04/ 14.04 and debian 7.5 to choose. But unfortunately odroid xu's hdmi output doesn't supported by ubuntu native firmware. So install ubuntu-desktop might can't be boot up for video output. + +- Burn images is much easy to install a pre-complied ubuntu system. I found this on odroid xu's forum, which contains xubuntu image \[[download](http://odroid.in/ubuntu_14.04lts/ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img.xz)\] for odroid xu. With this image, you just need to use dd command to write whole system mirror into sdcard. + +~~~~bash +# If .img end with xz, use this command to uncompress first +unxz ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img.xz +# Burn image into SD-card +sudo dd if=ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img of=/dev/sdb bs=1M conv=fsync +sync +~~~~ diff --git a/_site/archivers/some-of-my-previews-exper-work.html b/_site/archivers/some-of-my-previews-exper-work.html index 2245605..820bab4 100644 --- a/_site/archivers/some-of-my-previews-exper-work.html +++ b/_site/archivers/some-of-my-previews-exper-work.html @@ -84,6 +84,48 @@ But we also need some bash script to collect data through different size of rand

Time Experiment of seafile

+

Patch is based on seafile 5.1.4. You can find the release from seafile official repo. You may follow official compile instructions from here. [Patch]

+ +

How to collect data

+ +

We also need everything be done using scripting. But this time I only design added some distance between two increasing files’ sizes.

+ + + +
# CDC: content defined chucks
+# HUT: Http upload traffic
+# ALL: overall time of one commit & upload
+awk '/CDC|HUT|ALL/ {print $4,$5}' ~/.ccnet/log/seafile.log > results.stat
+
+
+ +

Install Seafile on odroid xu

+ +

Due to failure of my cross-compile to seafile on android. I used develop board as a replacement experiment platform for ARM-seafile testing. I used a odroid xu as hardware standard. Because all I need is an ARM platform, only an ARM-Ubuntu is enough for me. But develop prototype on a board is much fun than coding, I won’t address much this time. But I’ll start a blog telling some really cool stuff I made for a strange aim.

+ +

To install a ubuntu with GUI is my all preparation work. I found to way to do this.

+ + + +
# If .img end with xz, use this command to uncompress first
+unxz ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img.xz    
+# Burn image into SD-card
+sudo dd if=ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img of=/dev/sdb bs=1M conv=fsync
+sync
+
+
+ diff --git a/_site/feed.xml b/_site/feed.xml index 09007a0..d585af6 100644 --- a/_site/feed.xml +++ b/_site/feed.xml @@ -6,8 +6,8 @@ https://codersherlock.github.com// - Mon, 31 Oct 2016 17:08:36 -0400 - Mon, 31 Oct 2016 17:08:36 -0400 + Thu, 03 Nov 2016 00:20:36 -0400 + Thu, 03 Nov 2016 00:20:36 -0400 Jekyll v3.0.1 @@ -33,6 +33,48 @@ But we also need some bash script to collect data through different size of rand <h3 id="time-experiment-of-seafile">Time Experiment of seafile</h3> +<p>Patch is based on seafile 5.1.4. You can find the release from <a href="https://github.com/haiwen/seafile/releases">seafile official repo</a>. You may follow official compile instructions from <a href="https://manual.seafile.com/build_seafile/linux.html">here</a>. [<a href="">Patch</a>]</p> + +<h4 id="how-to-collect-data-1">How to collect data</h4> + +<p>We also need everything be done using scripting. But this time I only design added some distance between two increasing files’ sizes.</p> + +<ul> + <li>Start from 8K to 16M, 4 times increasing, modify at beginning/ at 1024 different places with python script. [<a href="/static/2016-11/seafile/trans.sh">Bash Script</a>|<a href="/static/2016-11/seafile/addbyte.py">Python program</a>]</li> + <li>After using this auto testing script, everything of output will be marked in log files of seafile, which located in <strong>~/.ccnet/log/seafile.log</strong></li> + <li>We need to use this simple awk code and vim operation to extract data.</li> +</ul> + +<div class="highlighter-rouge"><pre class="highlight"><code><span class="c"># CDC: content defined chucks</span> +<span class="c"># HUT: Http upload traffic</span> +<span class="c"># ALL: overall time of one commit &amp; upload</span> +awk <span class="s1">'/CDC|HUT|ALL/ {print $4,$5}'</span> ~/.ccnet/log/seafile.log &gt; results.stat +</code></pre> +</div> + +<h4 id="install-seafile-on-odroid-xu">Install Seafile on odroid xu</h4> + +<p>Due to failure of my cross-compile to seafile on android. I used develop board as a replacement experiment platform for ARM-seafile testing. I used a <a href="http://www.hardkernel.com/main/products/prdt_info.php?g_code=G137510300620">odroid xu</a> as hardware standard. Because all I need is an ARM platform, only an ARM-Ubuntu is enough for me. But develop prototype on a board is much fun than coding, I won’t address much this time. But I’ll start a blog telling some really cool stuff I made for a strange aim.</p> + +<p>To install a ubuntu with GUI is my all preparation work. I found to way to do this.</p> + +<ul> + <li> + <p><a href="http://www.armhf.com/boards/odroid-xu/">armhf</a> is a website for arm-based ubuntu. It has a detailed instruction to follow at <a href="http://www.armhf.com/boards/odroid-xu/odroid-sd-install/">here</a>. They also provide ubuntu 12.04/ 14.04 and debian 7.5 to choose. But unfortunately odroid xu’s hdmi output doesn’t supported by ubuntu native firmware. So install ubuntu-desktop might can’t be boot up for video output.</p> + </li> + <li> + <p>Burn images is much easy to install a pre-complied ubuntu system. I found this on odroid xu’s forum, which contains xubuntu image [<a href="http://odroid.in/ubuntu_14.04lts/ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img.xz">download</a>] for odroid xu. With this image, you just need to use dd command to write whole system mirror into sdcard.</p> + </li> +</ul> + +<div class="highlighter-rouge"><pre class="highlight"><code><span class="c"># If .img end with xz, use this command to uncompress first</span> +unxz ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img.xz +<span class="c"># Burn image into SD-card</span> +sudo dd <span class="k">if</span><span class="o">=</span>ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img <span class="nv">of</span><span class="o">=</span>/dev/sdb <span class="nv">bs</span><span class="o">=</span>1M <span class="nv">conv</span><span class="o">=</span>fsync +sync +</code></pre> +</div> + Fri, 28 Oct 2016 12:27:33 -0400 https://codersherlock.github.com//archivers/some-of-my-previews-exper-work diff --git a/_site/static/2016-11/seafile/addbyte.py b/_site/static/2016-11/seafile/addbyte.py new file mode 100644 index 0000000..a30ae02 --- /dev/null +++ b/_site/static/2016-11/seafile/addbyte.py @@ -0,0 +1,23 @@ +import sys +from subprocess import call +import os +import time +import math +import random + +hostfile = open(sys.argv[1],'r') +guestfile = open(sys.argv[2],'r') +targetfile = open(sys.argv[3],'w+') + +guest = guestfile.read() +target = hostfile.read() +byte_ndx = 0 +flt_byte = 0 +for i in range(0,len(guest)): + loc=random.randint(0,len(target)-1) + target = target[:loc]+guest[i]+target[loc:] + +targetfile.write(target) +hostfile.close() +guestfile.close() +targetfile.close() diff --git a/_site/static/2016-11/seafile/trans.sh b/_site/static/2016-11/seafile/trans.sh new file mode 100644 index 0000000..d03db89 --- /dev/null +++ b/_site/static/2016-11/seafile/trans.sh @@ -0,0 +1,23 @@ +#### THIS IS A SMALL TRANS SCRIPT #### + +PREFIX=$1 +echo $PREFIX +STARTSIZE=1024*8 + +let FILESIZE=$STARTSIZE/2 + +for i in `seq 1 6`; +do +let FILESIZE=$FILESIZE*4 +let CHANGESIZE=1024 + +dd if=/dev/urandom of=$PREFIX.$FILESIZE.dat bs=$FILESIZE count=1 +cp $PREFIX.$FILESIZE.dat ./FUCK/$PREFIX.$FILESIZE.dat +sleep 15s +dd if=/dev/urandom of=$CHANGESIZE.dat bs=$CHANGESIZE count=1 +cat $CHANGESIZE.dat $PREFIX.$FILESIZE.dat > $PREFIX.$FILESIZE.m.dat +#python ./addbyte.py $PREFIX.$FILESIZE.dat $CHANGESIZE.dat $PREFIX.$FILESIZE.m.dat +cp $PREFIX.$FILESIZE.m.dat ./FUCK/$PREFIX.$FILESIZE.dat +sleep 15s + +done diff --git a/_site/tools/hide/hideinfo.py b/_site/tools/hide/hideinfo.py new file mode 100644 index 0000000..288f2b5 --- /dev/null +++ b/_site/tools/hide/hideinfo.py @@ -0,0 +1,5 @@ +# Hide informations in static documents + +foldername = "../../static" + +print(foldername) diff --git a/_site/tools/hide/requirements.txt b/_site/tools/hide/requirements.txt new file mode 100644 index 0000000..f0bff40 --- /dev/null +++ b/_site/tools/hide/requirements.txt @@ -0,0 +1 @@ +pyopenssl diff --git a/static/2016-11/seafile/addbyte.py b/static/2016-11/seafile/addbyte.py new file mode 100644 index 0000000..a30ae02 --- /dev/null +++ b/static/2016-11/seafile/addbyte.py @@ -0,0 +1,23 @@ +import sys +from subprocess import call +import os +import time +import math +import random + +hostfile = open(sys.argv[1],'r') +guestfile = open(sys.argv[2],'r') +targetfile = open(sys.argv[3],'w+') + +guest = guestfile.read() +target = hostfile.read() +byte_ndx = 0 +flt_byte = 0 +for i in range(0,len(guest)): + loc=random.randint(0,len(target)-1) + target = target[:loc]+guest[i]+target[loc:] + +targetfile.write(target) +hostfile.close() +guestfile.close() +targetfile.close() diff --git a/static/2016-11/seafile/trans.sh b/static/2016-11/seafile/trans.sh new file mode 100644 index 0000000..d03db89 --- /dev/null +++ b/static/2016-11/seafile/trans.sh @@ -0,0 +1,23 @@ +#### THIS IS A SMALL TRANS SCRIPT #### + +PREFIX=$1 +echo $PREFIX +STARTSIZE=1024*8 + +let FILESIZE=$STARTSIZE/2 + +for i in `seq 1 6`; +do +let FILESIZE=$FILESIZE*4 +let CHANGESIZE=1024 + +dd if=/dev/urandom of=$PREFIX.$FILESIZE.dat bs=$FILESIZE count=1 +cp $PREFIX.$FILESIZE.dat ./FUCK/$PREFIX.$FILESIZE.dat +sleep 15s +dd if=/dev/urandom of=$CHANGESIZE.dat bs=$CHANGESIZE count=1 +cat $CHANGESIZE.dat $PREFIX.$FILESIZE.dat > $PREFIX.$FILESIZE.m.dat +#python ./addbyte.py $PREFIX.$FILESIZE.dat $CHANGESIZE.dat $PREFIX.$FILESIZE.m.dat +cp $PREFIX.$FILESIZE.m.dat ./FUCK/$PREFIX.$FILESIZE.dat +sleep 15s + +done diff --git a/tools/hide/hideinfo.py b/tools/hide/hideinfo.py new file mode 100644 index 0000000..288f2b5 --- /dev/null +++ b/tools/hide/hideinfo.py @@ -0,0 +1,5 @@ +# Hide informations in static documents + +foldername = "../../static" + +print(foldername) diff --git a/tools/hide/requirements.txt b/tools/hide/requirements.txt new file mode 100644 index 0000000..f0bff40 --- /dev/null +++ b/tools/hide/requirements.txt @@ -0,0 +1 @@ +pyopenssl