<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">vdgtu</journal-id><journal-title-group><journal-title xml:lang="ru">Вестник Дагестанского государственного технического университета. Технические науки</journal-title><trans-title-group xml:lang="en"><trans-title>Herald of Dagestan State Technical University. Technical Sciences</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2073-6185</issn><issn pub-type="epub">2542-095X</issn><publisher><publisher-name>Daghestan State Technical University</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.21822/2073-6185-2019-46-4-113-122</article-id><article-id custom-type="elpub" pub-id-type="custom">vdgtu-719</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ИНФОРМАТИКА, ВЫЧИСЛИТЕЛЬНАЯ ТЕХНИКА И УПРАВЛЕНИЕ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>COMPUTER SCIENCE, COMPUTER ENGINEERING AND MANAGEMENT</subject></subj-group></article-categories><title-group><article-title>ОБРАБОТКА ИЗОБРАЖЕНИЙ ТОВАРНЫХ ЧЕКОВ ДЛЯ ВЫДЕЛЕНИЯ И РАСПОЗНАВАНИЯ ТЕКСТОВОЙ ИНФОРМАЦИИ</article-title><trans-title-group xml:lang="en"><trans-title>PROCESSING IMAGES OF SALES RECEIPTS FOR ISOLATING AND RECOGNISING TEXT INFORMATION</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Наздрюхин</surname><given-names>А. С.</given-names></name><name name-style="western" xml:lang="en"><surname>Nazdryukhin</surname><given-names>A. S.</given-names></name></name-alternatives><bio xml:lang="ru"><p>студент,</p><p>656038, г. Барнаул, пр. Ленина, 46</p></bio><bio xml:lang="en"><p>Student,</p><p>46 Lenin Ave., Barnaul 656038</p></bio><email xlink:type="simple">a.nazdryukhin@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Храмцов</surname><given-names>И. Н.</given-names></name><name name-style="western" xml:lang="en"><surname>Khramtsov</surname><given-names>I. N.</given-names></name></name-alternatives><bio xml:lang="ru"><p>студент,</p><p>656038, г. Барнаул, пр. Ленина, 46</p></bio><bio xml:lang="en"><p>Student,</p><p>46 Lenin Ave., Barnaul 656038</p></bio><email xlink:type="simple">igorxramcov@yandex.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Тушев</surname><given-names>А. Н.</given-names></name><name name-style="western" xml:lang="en"><surname>Tushev</surname><given-names>A. N.</given-names></name></name-alternatives><bio xml:lang="ru"><p>кандидат технических наук, доцент кафедры информатики, вычислительной техники и информационной безопасности,</p><p>656038, г. Барнаул, пр. Ленина, 46</p></bio><bio xml:lang="en"><p>Cand. Sci. (Technical), Assoc. Prof., Department of Informatics, Computer Engineering and Information Security,</p><p>46 Lenin Ave., Barnaul 656038</p></bio><email xlink:type="simple">tushev51@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Алтайский государственный технический университет им. И.И. Ползунова</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Polzunov Altai State Technical University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2019</year></pub-date><pub-date pub-type="epub"><day>02</day><month>01</month><year>2020</year></pub-date><volume>46</volume><issue>4</issue><fpage>113</fpage><lpage>122</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Наздрюхин А.С., Храмцов И.Н., Тушев А.Н., 2020</copyright-statement><copyright-year>2020</copyright-year><copyright-holder xml:lang="ru">Наздрюхин А.С., Храмцов И.Н., Тушев А.Н.</copyright-holder><copyright-holder xml:lang="en">Nazdryukhin A.S., Khramtsov I.N., Tushev A.N.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://vestnik.dgtu.ru/jour/article/view/719">https://vestnik.dgtu.ru/jour/article/view/719</self-uri><abstract><sec><title>Цель</title><p>Цель. В данной статье рассматривается приложение, позволяющее осуществить обработку изображений товарных чеков для последующего извлечения текстовой информации с помощью Tesseract OCR Engine. Такое приложение полезно для ведения семейного бюджета или при проведении бухгалтерского учета в небольших компаниях. Основная проблема распознавания чеков – низкое качество краски и бумаги для печати, из-за чего она легко мнется и рвется, а напечатанные буквы быстро выцветают.</p></sec><sec><title>Метод</title><p>Метод. Исследование основано на ряде алгоритмов, основанных на методах математической морфологии операции размыкания, замыкания и морфологического градиента, преобразования изображений, которые позволяют существенно улучшить итоговое распознавание символов системой Tesseract.</p></sec><sec><title>Результат</title><p>Результат. Для решения этой проблемы был предложен специальный алгоритм нормализации изображения, включающий в себя нахождение чека на изображении, обработку полученного участка изображения, удаление дефектов съемки и дефектов носителя и точечную обработку для восстановления символов. Разработанное приложение позволяет значительно повысить точность распознавания текстовой информации при использовании Tesseract OCR.</p></sec><sec><title>Вывод</title><p>Вывод. Разработанная система распознает знаки с достаточно высокой точностью, и показывает результат выше, чем при распознавании оригинальным методом Tesseract, однако все же уступает точности распознавания ABBY FineReader. Также были предложены методы, предположительно позволяющие улучшить разработанный алгоритм. </p></sec></abstract><trans-abstract xml:lang="en"><sec><title>Objectives</title><p>Objectives. This article presents an application for the processing of scanned images of sales receipts for subsequent extraction of text information using the Tesseract OCR Engine. Such an application is useful for maintaining a family budget or for accounting in small companies. The main problem of receipt recognition is the low quality of ink and printing paper, which results in creasing and tears, as well as the rapid fading of printed characters.</p></sec><sec><title>Methods</title><p>Methods. The study is based on a number of algorithms based on mathematical morphology methods for opening, closing and morphological gradient operations, as well as image conversion, which can significantly improve the final recognition of characters by Tesseract.</p></sec><sec><title>Results</title><p>Results. In order to solve this problem, a special image normalisation algorithm is proposed, which includes locating a receipt on an image, processing the received image section, removing image capture and carrier defects, as well as point processing for restoring missing characters. The developed application supports increased recognition accuracy of text information when using Tesseract OCR.</p></sec><sec><title>Conclusion</title><p>Conclusion. The developed system recognises characters with fairly high accuracy, demonstrates a result that is better than that obtained when using the unmodified Tesseract method, but which is still inferior to the recognition accuracy of ABBY FineReader. Methods are also been proposed aimed at improving the developed algorithm. </p></sec></trans-abstract><kwd-group xml:lang="ru"><kwd>товарные чеки</kwd><kwd>обработка изображений</kwd><kwd>анализ изображений</kwd><kwd>OCR</kwd><kwd>нейронные сети</kwd></kwd-group><kwd-group xml:lang="en"><kwd>sales receipts</kwd><kwd>image processing</kwd><kwd>image analysis</kwd><kwd>OCR</kwd><kwd>neural networks</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Главная страница ABBYY FineReader, https://www.abbyy.com/en-us/finereader/</mixed-citation><mixed-citation xml:lang="en">ABBYY FineReader Homepage, https://www.abbyy.com/en-us/finereader/</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Главная страница Tesseract Open Source OCR Engine, https://github.com/tesseract-ocr/tesseract</mixed-citation><mixed-citation xml:lang="en">Tesseract Open Source OCR Engine, https://github.com/tesseract-ocr/tesseract</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Главная страница OpenCV Homepage, https://opencv.org/ 4. Gonzalez, R., Woods, R.: Digital Image Processing, 4th edn. – Pearson, New York, 2018.</mixed-citation><mixed-citation xml:lang="en">OpenCV Homepage, https://opencv.org/</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Bradley, D., Roth, G. Adaptive Thresholding using the Integral Image // J. Graphics Tools. – 2007. - №12. рр.13- 21.</mixed-citation><mixed-citation xml:lang="en">Gonzalez R., Woods, R.: Digital Image Processing, 4th edn. Pearson, New York (2018).</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Suzuki, S., Keiichi A. Be. Topological structural analysis of digitized binary images by border following // Computer Vision, Graphics, and Image Processing. – 1935. - №30(1). - p.32–46 .</mixed-citation><mixed-citation xml:lang="en">Bradley D., Roth, G.: Adaptive Thresholding using the Integral Image. J. Graphics Tools 12, 13-21 (2007).</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Sklansky, J.: Finding the Convex Hull of a Simple Polygon. Pattern Recognition Letters 1(2), 79-83 (1982).</mixed-citation><mixed-citation xml:lang="en">Suzuki S., Keiichi A. Be.: Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 30(1), 32–46 (1985).</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Sencar, H.T., Memon, N. Digital image forensics: There is more to a picture than meets the eye. Springer, New York (2013).</mixed-citation><mixed-citation xml:lang="en">Sklansky J.: Finding the Convex Hull of a Simple Polygon. Pattern Recognition Letters 1(2), 79-83 (1982).</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Chambolle, A., Caselles, V., Novaga, M., Cremers, D., Pock, T. An introduction to Total Variation for Image Analysis 9 (2010).</mixed-citation><mixed-citation xml:lang="en">Sencar H.T., Memon, N.: Digital image forensics: There is more to a picture than meets the eye. Springer, New York (2013).</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Ma, Z. &amp; Wen, J. Single-scale Retinex sea fog removal algorithm fused the edge information // Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics 27. 217-225 (2015).</mixed-citation><mixed-citation xml:lang="en">Chambolle A., Caselles V., Novaga M., Cremers D., Pock, T.: An introduction to Total Variation for Image Analysis 9 (2010).</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Li, B., Xu, D., Lee, M., Feng, S. A Multi-Scale Adaptive Grey World Algorithm // IEICE Transactions 90-D, 1121-1124 (2007).</mixed-citation><mixed-citation xml:lang="en">Ma Z. &amp; Wen, J.:Single-scale Retinex sea fog removal algorithm fused the edge information. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics 27. 217-225 (2015).</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Babakhani, R., Zarei, P. Automatic gamma correction based on average of brightness // Advances in Computer Science: an International Journal 4(6), 156-159 (2015).</mixed-citation><mixed-citation xml:lang="en">Li, B., Xu, D., Lee, M., Feng, S.: A Multi-Scale Adaptive Grey World Algorithm. IEICE Transactions 90-D, 1121-1124 (2007).</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Rahman, Sh., Rahman, Md. Mostafijur, Abdullah-Al-Wadud, M., Al-Quaderi, Golam Dastegir, Shoyaib, M. An adaptive gamma correction for image enhancement // EURASIP Journal on Image and Video Processing 35, (2016).</mixed-citation><mixed-citation xml:lang="en">Babakhani R., Zarei P.: Automatic gamma correction based on average of brightness. Advances in Computer Science: an International Journal 4(6), 156-159 (2015).</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Haralick, R., Shapiro, L. Computer and Robot Vision, 1st edn, Addison-Wesley Publishing Company, Boston (1992).</mixed-citation><mixed-citation xml:lang="en">Rahman, Sh., Rahman, Md. Mostafijur, Abdullah-Al-Wadud, M., Al-Quaderi, Golam Dastegir, Shoyaib, M.: An adaptive gamma correction for image enhancement. EURASIP Journal on Image and Video Processing 35, (2016).</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Marr, D., Hildreth, E. Theory of Edge Detection. Proceedings of the Royal Society of London B 207, 187- 217 (1980)</mixed-citation><mixed-citation xml:lang="en">Haralick R., Shapiro, L.: Computer and Robot Vision, 1st edn, Addison-Wesley Publishing Company, Boston (1992).</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Пелевин Е.Е., Балясный С.В. Использование метода Adaptive Threshold в системе технического зрения // Juvenis scientia. 2017. №1. С. 4-7.</mixed-citation><mixed-citation xml:lang="en">Marr D., Hildreth, E.: Theory of Edge Detection. Proceedings of the Royal Society of London B 207, 187- 217 (1980)</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">A.Rosebrock, Practical Python and OpenCV, 3rd edn. PyImageSearch.com (2016).</mixed-citation><mixed-citation xml:lang="en">Pelevin Ye.Ye., Balyasnyy S.V. Ispol'zovaniye metoda Adaptive Threshold v sisteme tekhniche-skogo zreniya // Juvenis Scientia. 2017. №1. S. 4-7. [Pelevin, E., Balyasny, S.: The usage of adaptive threshold method in the system of computer vision. Juvenis Scientia 1, 4-7 (2017). (In Russ)]</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Tomasi, C., Manduchi, R. Bilateral filtering for gray and color images // Sixth International Conference on Computer Vision, 839-846 (1998).</mixed-citation><mixed-citation xml:lang="en">A.Rosebrock, Practical Python and OpenCV, 3rd edn. PyImageSearch.com (2016).</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Peter Norvig’s cite: How to write a spelling corrector, https://norvig.com/spell-correct.html, last accessed 2019/11/30.</mixed-citation><mixed-citation xml:lang="en">Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. Sixth International Conference on Computer Vision, 839-846 (1998).</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Liu, X., Cheng, K., Luo, Y., Duh, K., &amp; Matsumoto, Y. A hybrid Chinese spelling correction using language model and statistical machine translation with reranking // In Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, 54-58 (2013).</mixed-citation><mixed-citation xml:lang="en">Peter Norvig’s cite: How to write a spelling corrector, https://norvig.com/spell-correct.html, last accessed 2019/11/30.</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Popov, V., Kudinov, M., Piontkovskaya, I., Vytovtov, P., Nevidomsky, A. Differentially Private Distributed Learning for Language Modeling Tasks (2017). arXiv, https://arxiv.org/abs/1712.07473</mixed-citation><mixed-citation xml:lang="en">Liu, X., Cheng, K., Luo, Y., Duh, K., &amp; Matsumoto, Y.: A hybrid Chinese spelling correction using language model and statistical machine translation with reranking. In Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, 54-58 (2013).</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Popov, V., Kudinov, M., Piontkovskaya, I., Vytovtov, P., Nevidomsky, A.: Differentially Private Distributed Learning for Language Modeling Tasks (2017), https://arxiv.org/abs/1712.07473</mixed-citation><mixed-citation xml:lang="en">Popov, V., Kudinov, M., Piontkovskaya, I., Vytovtov, P., Nevidomsky, A.: Differentially Private Distributed Learning for Language Modeling Tasks (2017), https://arxiv.org/abs/1712.07473</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
