Some of my previews experiment works

Fri, 28 Oct 2016 12:27:33 -0400

Time series

2016-10

Time Experiment of rsync

Patch is based on rsync with version 3.1.2. [Rsync|Patch]

How to collect data

Basically, everything of transmission time and computation time will be output with overall time will be printed on the console.
But we also need some bash script to collect data through different size of random size and with different modification through them.

Start from 8K to 64M, modify at beginning, [Bash script]
Start from 8K to 64M, modify at last, [Bash script]
Start from 8K to 64M, modify at random place with a (slow) python script, [Bash script|Python program]

Time Experiment of seafile

Patch is based on seafile 5.1.4. You can find the release from seafile official repo. You may follow official compile instructions from here. [Patch]

How to collect data

We also need everything be done using scripting. But this time I only design added some distance between two increasing files’ sizes.

Start from 8K to 16M, 4 times increasing, modify at beginning/ at 1024 different places with python script. [Bash Script|Python program]
After using this auto testing script, everything of output will be marked in log files of seafile, which located in ~/.ccnet/log/seafile.log
We need to use this simple awk code and vim operation to extract data.

# CDC: content defined chucks
# HUT: Http upload traffic
# ALL: overall time of one commit & upload
awk '/CDC|HUT|ALL/ {print $4,$5}' ~/.ccnet/log/seafile.log > results.stat

Install Seafile on odroid xu

Due to failure of my cross-compile to seafile on android. I used develop board as a replacement experiment platform for ARM-seafile testing. I used a odroid xu as hardware standard. Because all I need is an ARM platform, only an ARM-Ubuntu is enough for me. But develop prototype on a board is much fun than coding, I won’t address much this time. But I’ll start a blog telling some really cool stuff I made for a strange aim.

To install a ubuntu with GUI is my all preparation work. I found to way to do this.

armhf is a website for arm-based ubuntu. It has a detailed instruction to follow at here. They also provide ubuntu 12.04/ 14.04 and debian 7.5 to choose. But unfortunately odroid xu’s hdmi output doesn’t supported by ubuntu native firmware. So install ubuntu-desktop might can’t be boot up for video output.
Burn images is much easy to install a pre-complied ubuntu system. I found this on odroid xu’s forum, which contains xubuntu image [download] for odroid xu. With this image, you just need to use dd command to write whole system mirror into sdcard.

# If .img end with xz, use this command to uncompress first
unxz ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img.xz    
# Burn image into SD-card
sudo dd if=ubuntu-14.04lts-xubuntu-odroid-xu-20140714.img of=/dev/sdb bs=1M conv=fsync
sync

Using charles proxy to monitor mobile SSL traffics

Thu, 27 Oct 2016 22:50:33 -0400

In this blog, I will generally talk about how to use proper tools to monitor SSL traffics of a mobile devices. Currently, I only can dealing with those SSL traffics which use an obviously certification. Some applications may not using system root cert or they doesn’t provide us a method to modify their own certs. For these situation, I still didn’t find a good solutions for it. But I’ll keep updating this if I get one.
My current solution is using AP to forward all SSL traffic to a proxy, charles proxy is my first choice (Prof asked). It’s a non-free software which still update new versions now. So mainly, I’ll talk about how to charles SSL proxy.

Preparations

Monitor device situation: Linux Machine with wireless adapter
Download the newest version(4.0.1) of charles
Target android devices with root privilege

Stop Talking is the worst title of one blog

Wed, 26 Oct 2016 22:50:33 -0400

Stop Talking, Start Doing - 停止空想，开始行动

Some of my previews experiment works

Time series

2016-10

Time Experiment of rsync

How to collect data

Time Experiment of seafile

How to collect data

Install Seafile on odroid xu

Using charles proxy to monitor mobile SSL traffics

Preparations

Stop Talking is the worst title of one blog