TY - GEN
T1 - ETAOSD
T2 - 2013 1st IEEE International Conference on Computing, Electrical and Electronics Engineering, ICCEEE 2013
AU - Baloul, Fadlelmoula Mohamed
AU - Abdullah, Mohsin Hassan
AU - Babikir, Elsadig Ahmed
PY - 2013
Y1 - 2013
N2 - The aim of this paper is to present a new static dictionary-based algorithm for text transformation to increase the data compression ratio when using standard compression tools. The basic idea of the new algorithm is to define a pattern for each word in a static dictionary by replacing all or most of the characters in the words of the dictionary by the most frequently used character in any text file. The proposed algorithm transforms any text file into another encrypted file with a size almost the same as that of the original text file but with different statistical properties. The new transformation method has been designed, implemented, and tested using Gutenburg Corpus. Generally, the output result has shown different levels of enhancements on different common standard data compression tools such as Arithmetic, Huffman, Bzip2, Gzip and WinZip. The compression performance of all common compression tools has been enhanced especially when the patterns of the transformed words passed through costless running length encoding (RLE) algorithm. On using Bzip2, the resultant output files produced about 76.75% as compression ratio with 1.88 as average code length. The final result is very promising and it could be enhanced more in case of applying dynamic dictionary-based text transformation technique.
AB - The aim of this paper is to present a new static dictionary-based algorithm for text transformation to increase the data compression ratio when using standard compression tools. The basic idea of the new algorithm is to define a pattern for each word in a static dictionary by replacing all or most of the characters in the words of the dictionary by the most frequently used character in any text file. The proposed algorithm transforms any text file into another encrypted file with a size almost the same as that of the original text file but with different statistical properties. The new transformation method has been designed, implemented, and tested using Gutenburg Corpus. Generally, the output result has shown different levels of enhancements on different common standard data compression tools such as Arithmetic, Huffman, Bzip2, Gzip and WinZip. The compression performance of all common compression tools has been enhanced especially when the patterns of the transformed words passed through costless running length encoding (RLE) algorithm. On using Bzip2, the resultant output files produced about 76.75% as compression ratio with 1.88 as average code length. The final result is very promising and it could be enhanced more in case of applying dynamic dictionary-based text transformation technique.
KW - Average Code Length (ACL)
KW - Text Compression
KW - Text Preprocessing
KW - Text Transformation
UR - http://www.scopus.com/inward/record.url?scp=84889578963&partnerID=8YFLogxK
U2 - 10.1109/ICCEEE.2013.6633967
DO - 10.1109/ICCEEE.2013.6633967
M3 - Conference contribution
AN - SCOPUS:84889578963
SN - 9781467362313
T3 - Proceedings - 2013 International Conference on Computer, Electrical and Electronics Engineering: 'Research Makes a Difference', ICCEEE 2013
SP - 384
EP - 389
BT - Proceedings - 2013 International Conference on Computer, Electrical and Electronics Engineering
Y2 - 26 August 2013 through 28 August 2013
ER -