Skip to content

How to pull a file file from a NFS (network file system,on-premise machine with disk mounted) as source into Data fusion #9

@stevenzhang-support

Description

@stevenzhang-support

Issue type: Feature Request

Problem you have encountered:
I ran into an issue when I wanted to have a feature to be supported to fetch a file from a NFS (network file system,on-premise machine with disk mounted) as a source.

What you expected to happen:

  1. A data fusion plugin or this ftp-plugin to perform file fetching with NFS source can be set and
  2. A file polling can be possible when new files appear from the source and will be picked up automatically or a scheduler can be set together with ftp fetching from NFS source.

Other information (workarounds you have tried, documentation consulted, etc):
I tried to share a solution by considering [1] and combining airflow ftp operators under schedule to fetch a file from a NFS(network file system) source using FTP protocol. It seems there is no existing file or FTP plugin that can do the file fetching using a scheduler.

[1] https://stackoverflow.com/questions/48248369/how-to-implement-polling-in-airflow

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions