東華大學圖書館 |

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.

紀錄類型:	書目-電子資源 : Monograph/item
正題名/作者:	Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings./
作者:	Zhang, Zhuomin.
出版者:	Ann Arbor : ProQuest Dissertations & Theses, : 2023,
面頁冊數:	143 p.
附註:	Source: Dissertations Abstracts International, Volume: 85-05, Section: A.
Contained By:	Dissertations Abstracts International85-05A.
標題:	Artists. -
電子資源:	https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30720669
ISBN:	9798380729819

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.
Zhang, Zhuomin.

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings. - Ann Arbor : ProQuest Dissertations & Theses, 2023 - 143 p.

Source: Dissertations Abstracts International, Volume: 85-05, Section: A.

Thesis (Ph.D.)--The Pennsylvania State University, 2023.

The rapid development of imaging technologies has revolutionized image acquisition and led to an unprecedented explosion in the volume of visual data, which has become an integral part of our daily lives. Furthermore, in most real-world scenarios, data is often collected from different sources, referred to as different "domains," each with its own characteristics and properties. Recently, the utilization of advanced machine learning (ML) algorithms to analyze cross-domain images has gained significant attention in various research fields. Cross-domain image analysis aims to: (1) identify and characterize similarities and discrepancies among images belonging to different domains; and (2) transfer knowledge learned from one domain to another domain for further image analysis tasks, which can help to resolve the issues of limited labeled data and domain-specific variations. Over the past decades, researchers have developed various techniques and methods to attain the objectives of cross-domain image analysis, which include domain adaptation, transfer learning, and deep-learning-based methods. Motivated by the superiority of these devised analysis approaches, this dissertation aims to advance the state-of-the-art in cross-domain image analysis, contributing to the development of more effective and robust machine learning models that can benefit a wide range of research fields.In this dissertation, we present two research problems and corresponding solutions from the biomedical and art historical perspectives to demonstrate the capability of advanced machine learning algorithms and underlying challenges when dealing with cross-domain images analysis. The first part discusses the utilization of the idea of image translation to achieve placenta segmentation from photos collected from different sources. For each photo, four regions need to be segmented, placenta disc, umbilical cord, ruler, and background. Specifically, we propose a multi-region saliency-aware learning (MSL) method for cross-domain placenta image segmentation by enforcing semantic consistency. Firstly, an attention module is added to the adversarial image translation process to get the most discriminative regions (ruler and background). Subsequently, a novel attention-consistent loss serves as an extra constraint to enforce the preservation of the attention-related information during the translation. Notably, we also propose a new saliency-consistent loss as another supervision to guarantee salient regions are consistent before and after translation. Then, we will use a well-trained convolutional neural network (CNN) model from the annotation-sufficient domain to achieve the segmentation task in another domain following image translation. The experimental results demonstrate the superiority of the proposed MSL model to solve the cross-domain segmentation problem for placenta photos. Furthermore, after the segmentation, an automatic pipeline is developed to extract specific visual characteristics from placenta photos for pathological diagnosis.Another topic is for studying the European art style known as realism. The specific case study we report here is the work of John Constable (1776-1837) who achieved a remarkable degree of naturalism in his sky painting. Specifically, we propose a new ML based paradigm for studying pictorial realism in a more objective way. Our framework assesses realism by measuring the similarity between two domains: clouds painted by artists known for their depictions of skies, like Constable, and photographs of clouds. The similarity is computed from two aspects, the accuracy of cloud classification and the discrepancy of painting styles. Our basic assumption is that if the paintings imitate observed reality well, painted clouds can be accurately classified by the classifier trained with cloud photos because they follow the similar feature representation documented in the photographs. The experimental results of cloud classification show that Constable more consistently approximates the formal features of actual clouds in his paintings than his contemporaries. We also put forward new evaluation metrics based on disentangled style features to carefully analyze the style discrepancy between paintings and photographs of clouds as well as between Constable and his contemporaries. We find that the painting style of Lionel Constable is most similar to the style of his father, John Constable, thereby verifying the opinions of art historians that he emulated his father's painting for practice. The study, as a novel interdisciplinary approach that combines machine learning, meteorology, and art history, is a springboard for broader and deeper analyses of pictorial realism.In addition, instead of only focusing on cross-domain artwork analysis, we discuss the potential biases that may appear in the general ML-based artwork analysis process as a supplement. Although recent research studies have substantially shown the effectiveness and applicability of machine learning for art understanding and creation, it has been argued that understanding or creating art is a human-defined procedure, which not only depends on stereotyped cognition or changeless laws, but also mixes with individual biases. Therefore, the procedure of analyzing artworks by virtue of intelligent machines can also be biased. Different kinds of biases such as labeling bias, design bias, and confounding bias can exist at any stage in the procedure of ML-based artwork analysis, unprofessional data curation, incomplete problem formulation, unreasonable algorithm design, subjective evaluation methods, etc. Since ignoring these biases could have negative impact on the precision and reliability of the experimental results, we are thus motivated to investigate these biases from both machine learning and art history perspectives and provide insights on how to systematically address them.

ISBN: 9798380729819Subjects--Topical Terms:

524768
Artists.
Subjects--Index Terms:

Visual data

Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.
LDR:07217nmm a2200397 4500 001 2398907
005 20240819061927.5
006 m o d
007 cr#unu||||||||
008 251215s2023 ||||||||||||||||| ||eng d
020 $a 9798380729819
035 $a (MiAaPQ)AAI30720669
035 $a (MiAaPQ)PennState_30373zxz78
035 $a AAI30720669
040 $a MiAaPQ $c MiAaPQ
100 1 $a Zhang, Zhuomin. $3 3768857
245 1 0 $a Cross-domain Image Analysis Approaches Towards Segmentation of Placenta Photos and Pictorial Realism Study of Paintings.
260 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2023
300 $a 143 p.
500 $a Source: Dissertations Abstracts International, Volume: 85-05, Section: A.
500 $a Advisor: Wang, James Z.;Li, Jia.
502 $a Thesis (Ph.D.)--The Pennsylvania State University, 2023.
520 $a The rapid development of imaging technologies has revolutionized image acquisition and led to an unprecedented explosion in the volume of visual data, which has become an integral part of our daily lives. Furthermore, in most real-world scenarios, data is often collected from different sources, referred to as different "domains," each with its own characteristics and properties. Recently, the utilization of advanced machine learning (ML) algorithms to analyze cross-domain images has gained significant attention in various research fields. Cross-domain image analysis aims to: (1) identify and characterize similarities and discrepancies among images belonging to different domains; and (2) transfer knowledge learned from one domain to another domain for further image analysis tasks, which can help to resolve the issues of limited labeled data and domain-specific variations. Over the past decades, researchers have developed various techniques and methods to attain the objectives of cross-domain image analysis, which include domain adaptation, transfer learning, and deep-learning-based methods. Motivated by the superiority of these devised analysis approaches, this dissertation aims to advance the state-of-the-art in cross-domain image analysis, contributing to the development of more effective and robust machine learning models that can benefit a wide range of research fields.In this dissertation, we present two research problems and corresponding solutions from the biomedical and art historical perspectives to demonstrate the capability of advanced machine learning algorithms and underlying challenges when dealing with cross-domain images analysis. The first part discusses the utilization of the idea of image translation to achieve placenta segmentation from photos collected from different sources. For each photo, four regions need to be segmented, placenta disc, umbilical cord, ruler, and background. Specifically, we propose a multi-region saliency-aware learning (MSL) method for cross-domain placenta image segmentation by enforcing semantic consistency. Firstly, an attention module is added to the adversarial image translation process to get the most discriminative regions (ruler and background). Subsequently, a novel attention-consistent loss serves as an extra constraint to enforce the preservation of the attention-related information during the translation. Notably, we also propose a new saliency-consistent loss as another supervision to guarantee salient regions are consistent before and after translation. Then, we will use a well-trained convolutional neural network (CNN) model from the annotation-sufficient domain to achieve the segmentation task in another domain following image translation. The experimental results demonstrate the superiority of the proposed MSL model to solve the cross-domain segmentation problem for placenta photos. Furthermore, after the segmentation, an automatic pipeline is developed to extract specific visual characteristics from placenta photos for pathological diagnosis.Another topic is for studying the European art style known as realism. The specific case study we report here is the work of John Constable (1776-1837) who achieved a remarkable degree of naturalism in his sky painting. Specifically, we propose a new ML based paradigm for studying pictorial realism in a more objective way. Our framework assesses realism by measuring the similarity between two domains: clouds painted by artists known for their depictions of skies, like Constable, and photographs of clouds. The similarity is computed from two aspects, the accuracy of cloud classification and the discrepancy of painting styles. Our basic assumption is that if the paintings imitate observed reality well, painted clouds can be accurately classified by the classifier trained with cloud photos because they follow the similar feature representation documented in the photographs. The experimental results of cloud classification show that Constable more consistently approximates the formal features of actual clouds in his paintings than his contemporaries. We also put forward new evaluation metrics based on disentangled style features to carefully analyze the style discrepancy between paintings and photographs of clouds as well as between Constable and his contemporaries. We find that the painting style of Lionel Constable is most similar to the style of his father, John Constable, thereby verifying the opinions of art historians that he emulated his father's painting for practice. The study, as a novel interdisciplinary approach that combines machine learning, meteorology, and art history, is a springboard for broader and deeper analyses of pictorial realism.In addition, instead of only focusing on cross-domain artwork analysis, we discuss the potential biases that may appear in the general ML-based artwork analysis process as a supplement. Although recent research studies have substantially shown the effectiveness and applicability of machine learning for art understanding and creation, it has been argued that understanding or creating art is a human-defined procedure, which not only depends on stereotyped cognition or changeless laws, but also mixes with individual biases. Therefore, the procedure of analyzing artworks by virtue of intelligent machines can also be biased. Different kinds of biases such as labeling bias, design bias, and confounding bias can exist at any stage in the procedure of ML-based artwork analysis, unprofessional data curation, incomplete problem formulation, unreasonable algorithm design, subjective evaluation methods, etc. Since ignoring these biases could have negative impact on the precision and reliability of the experimental results, we are thus motivated to investigate these biases from both machine learning and art history perspectives and provide insights on how to systematically address them.
590 $a School code: 0176.
650 4 $a Artists. $3 524768
650 4 $a Photographs. $3 627415
650 4 $a Feces. $3 544385
650 4 $a Maps. $3 544078
650 4 $a Painters. $3 549126
650 4 $a Landscape art. $3 3768858
650 4 $a Realism. $3 528996
650 4 $a Painting. $3 524049
650 4 $a Art history. $3 2122701
650 4 $a Art criticism. $3 526357
650 4 $a Fine arts. $3 2122690
653 $a Visual data
653 $a Cross-domain image analysis
653 $a Image acquisition
653 $a Multi-region saliency-aware learning
653 $a Placenta segmentation
690 $a 0357
690 $a 0365
690 $a 0377
710 2 $a The Pennsylvania State University. $3 699896
773 0 $t Dissertations Abstracts International $g 85-05A.
790 $a 0176
791 $a Ph.D.
792 $a 2023
793 $a English
856 4 0 $u https://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30720669