---
title: "Text Deduplication - AllTools"
description: "Automatically identifies and deletes duplicate lines in text, supporting options such as preserving first occurrence, case-sensitivity, and ignoring whitespace."
canonical_url: "https://tool.warmday.wang/en/text/deduplicate"
meta:
  author: AllTools
  keywords: "online tools, AllTools, free online tools, developer tools, image tools, PDF tools, text tools, unit converter, no login, browser-based tools"
  "og:description": "Automatically identifies and deletes duplicate lines in text, supporting options such as preserving first occurrence, case-sensitivity, and ignoring whitespace."
  "og:image": "https://tool.warmday.wang/img/og-cover.png"
  "og:image:alt": "AllTools Logo"
  "og:image:height": "630"
  "og:image:width": "1200"
  "og:title": "Text Deduplication"
  "twitter:image": "https://tool.warmday.wang/img/og-cover.png"
---

> Index of every page on this site: [llms.txt](https://tool.warmday.wang/llms.txt)

# **Text Deduplication**

Deduplicate by row, keeping rows that appear for the first time.

## **Input Text**

**Case-insensitive**

**Trim Spaces**

**Ignore empty rows**

Rows · Row Unique · Row Duplicate

### **Instructions**

#### **Introduction**

Automatically identifies and deletes duplicate lines in text, supporting options such as preserving first occurrence, case-sensitivity, and ignoring whitespace.

#### **Steps**

Paste the text that needs to be de-duplicated, check the de-duplication option (such as case-sensitive, ignore blanks), click De-duplicate, and copy the result.

#### **Notes**

The order of the rows after deduplication remains the same; if you want to sort at the same time, please use it with the sorting tool.

## **Related tools**

More from the same category · Text Processing

[**Kaomoji Collection**Cute kaomoji ready to copy](https://tool.warmday.wang/en/text/kaomoji) [**Word Count**Count Chinese characters, words and characters](https://tool.warmday.wang/en/text/count) [**Text Diff**Online text difference comparison](https://tool.warmday.wang/en/text/diff) [**Text Sorter**Sort lines ascending, descending, natural or random](https://tool.warmday.wang/en/text/sort) [**Find and Replace**Find and replace with regex support](https://tool.warmday.wang/en/text/find-replace) [**Case Converter**UPPER, lower, Title, Camel, Snake, Kebab and Constant case](https://tool.warmday.wang/en/text/case-converter)

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://tool.warmday.wang/#organization","name":"AllTools","alternateName":"AllTools - 全能工具箱","url":"https://tool.warmday.wang/","logo":{"@type":"ImageObject","url":"https://tool.warmday.wang/img/logo.png","width":512,"height":512}},{"@type":"WebSite","@id":"https://tool.warmday.wang/en#website","url":"https://tool.warmday.wang/en","name":"AllTools","inLanguage":"en","publisher":{"@id":"https://tool.warmday.wang/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://tool.warmday.wang/en?q={search_term_string}"},"query-input":"required name=search_term_string"}},{"@type":"WebPage","@id":"https://tool.warmday.wang/en/text/deduplicate#webpage","url":"https://tool.warmday.wang/en/text/deduplicate","isPartOf":{"@id":"https://tool.warmday.wang/en#website"},"inLanguage":"en","name":"Text Deduplication","description":"Automatically identifies and deletes duplicate lines in text, supporting options such as preserving first occurrence, case-sensitivity, and ignoring whitespace."},{"@type":"SoftwareApplication","@id":"https://tool.warmday.wang/en/text/deduplicate#app","name":"Text Deduplication","description":"Automatically identifies and deletes duplicate lines in text, supporting options such as preserving first occurrence, case-sensitivity, and ignoring whitespace.","url":"https://tool.warmday.wang/en/text/deduplicate","applicationCategory":"UtilitiesApplication","operatingSystem":"Web","inLanguage":"en","isPartOf":{"@id":"https://tool.warmday.wang/en/text/deduplicate#webpage"},"offers":{"@type":"Offer","price":"0","priceCurrency":"CNY"}},{"@type":"BreadcrumbList","@id":"https://tool.warmday.wang/en/text/deduplicate#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://tool.warmday.wang/en"},{"@type":"ListItem","position":2,"name":"Text Tools","item":"https://tool.warmday.wang/en/text"},{"@type":"ListItem","position":3,"name":"Text Deduplication","item":"https://tool.warmday.wang/en/text/deduplicate"}]}]}
```

## Sitemap

See the full [sitemap](https://tool.warmday.wang/sitemap.md) for all pages.
