ConvertTo-HtmlDatasetJsonL

August 3, 2026 ยท View on GitHub

SYNOPSIS

Converts a page workbench result or HTML input into LLM-ready dataset JSON Lines.

SYNTAX

Workbench (Default)

ConvertTo-HtmlDatasetJsonL [-Workbench] <HtmlPageWorkbenchResult> [-MaxChunkWords <int>] [-NoMarkdown] [-NoProvenance] [-NoRedactionHints] [-AsObject] [<CommonParameters>]

Content

ConvertTo-HtmlDatasetJsonL [-Content] <string> [-BaseUrl <uri>] [-MaxChunkWords <int>] [-NoMarkdown] [-NoProvenance] [-NoRedactionHints] [-AsObject] [<CommonParameters>]

Url

ConvertTo-HtmlDatasetJsonL [-Url] <uri> [-MaxChunkWords <int>] [-NoMarkdown] [-NoProvenance] [-NoRedactionHints] [-AsObject] [-Proxy <string>] [-ProxyCredential <pscredential>] [<CommonParameters>]

Path

ConvertTo-HtmlDatasetJsonL [-Path] <string> [-BaseUrl <uri>] [-MaxChunkWords <int>] [-NoMarkdown] [-NoProvenance] [-NoRedactionHints] [-AsObject] [<CommonParameters>]

DESCRIPTION

Converts a page workbench result or HTML input into LLM-ready dataset JSON Lines.

EXAMPLES

EXAMPLE 1

Invoke-HtmlPageWorkbench -Url https://example.com | ConvertTo-HtmlDatasetJsonL

PARAMETERS

-AsObject

Returns chunk objects instead of JSON Lines.

Type: SwitchParameter
Parameter Sets: Workbench, Content, Url, Path
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-BaseUrl

Base URL used to resolve relative links and provenance when Content or Path is used.

Type: Uri
Parameter Sets: Content, Path
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-Content

HTML content to inspect and convert.

Type: String
Parameter Sets: Content
Aliases: None
Possible values:

Required: True
Position: 0
Default value: None
Accept pipeline input: True (ByValue)
Accept wildcard characters: False

-MaxChunkWords

Maximum number of words per dataset chunk.

Type: Int32
Parameter Sets: Workbench, Content, Url, Path
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-NoMarkdown

Omits markdown content from dataset chunks.

Type: SwitchParameter
Parameter Sets: Workbench, Content, Url, Path
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-NoProvenance

Omits provenance entries from dataset chunks.

Type: SwitchParameter
Parameter Sets: Workbench, Content, Url, Path
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-NoRedactionHints

Omits redaction hints from dataset chunks.

Type: SwitchParameter
Parameter Sets: Workbench, Content, Url, Path
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-Path

Path to a local HTML file to convert.

Type: String
Parameter Sets: Path
Aliases: File
Possible values:

Required: True
Position: 0
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-Proxy

Proxy server address used when downloading by URL.

Type: String
Parameter Sets: Url
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-ProxyCredential

Credentials used with the proxy server.

Type: PSCredential
Parameter Sets: Url
Aliases: None
Possible values:

Required: False
Position: named
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-Url

URL of the page to download and convert.

Type: Uri
Parameter Sets: Url
Aliases: Uri
Possible values:

Required: True
Position: 0
Default value: None
Accept pipeline input: False
Accept wildcard characters: False

-Workbench

Page workbench result to convert.

Type: HtmlPageWorkbenchResult
Parameter Sets: Workbench
Aliases: None
Possible values:

Required: True
Position: 0
Default value: None
Accept pipeline input: True (ByValue)
Accept wildcard characters: False

CommonParameters

This cmdlet supports the common parameters: -Debug, -ErrorAction, -ErrorVariable, -InformationAction, -InformationVariable, -OutVariable, -OutBuffer, -PipelineVariable, -Verbose, -WarningAction, and -WarningVariable. For more information, see about_CommonParameters.

INPUTS

  • HtmlTinkerX.HtmlPageWorkbenchResult
  • System.String

OUTPUTS

  • System.String
  • HtmlTinkerX.HtmlPageDatasetChunk
  • None