Feature/tiered storage by foodprocessor · Pull Request #1049 · Seagate/cloudfuse

foodprocessor · 2026-09-10T22:34:10Z

Add tiered storage component.

…penFile

…t OpenFile test pass

…File

… with no file attatched, also added some config path

…ontrol

…ion), added tests for OpenFile O_Create

Feature/tiered storage setup

Feature/tiered storage

mend-for-github-com · 2026-09-11T15:31:52Z

+	if err != nil {
+		return err
+	}
+	err = os.MkdirAll(filepath.Dir(localPath), 0755)


Mend Code Security Check

New finding (1 of 5)

The Mend Code Security Check of your branch failed because of a Insecure Directory Permissions finding in this line.

Severity Vulnerability Type CWE File Data Flows Detected
High Insecure Directory Permissions
CWE-732

tiered_storage.go:680
1 2026-09-10 10:35pm
Vulnerable Code

cloudfuse/component/tiered_storage/tiered_storage.go

Lines 675 to 680 in d221a90

func (c *TieredStorage) downloadCopyFromCloud(options internal.OpenFileOptions) error {

localPath, err := c.localPath(options.Name)

if err != nil {

return err

}

err = os.MkdirAll(filepath.Dir(localPath), 0755)

1 Data Flow/s detected

cloudfuse/component/tiered_storage/tiered_storage.go

Line 680 in d221a90

err = os.MkdirAll(filepath.Dir(localPath), 0755)

Secure Code Warrior Training Material

Suppress Finding

To suppress this finding as a acceptable risk, comment:

/mend code suppress acceptable-risk 4dc813a7-848f-4f06-87c3-32a1d946c60b Optional Comment

To suppress this finding as a false positive, comment:

/mend code suppress false-positive 4dc813a7-848f-4f06-87c3-32a1d946c60b Optional Comment

💬 Discuss Finding

Add context or questions for the security reviewer by commenting on this issue:

/mend comment Your Message

Your message will appear in the Mend Platform for the security team to review.

mend-for-github-com · 2026-09-11T15:31:53Z

+	if c.tmpPath == "" || c.tmpPath == "." {
+		return fmt.Errorf("TieredStorage: path not set in config")
+	}
+	err = os.MkdirAll(c.tmpPath, 0755)


Mend Code Security Check

New finding (2 of 5)

The Mend Code Security Check of your branch failed because of a Insecure Directory Permissions finding in this line.

Severity Vulnerability Type CWE File Data Flows Detected
High Insecure Directory Permissions
CWE-732

tiered_storage.go:166
1 2026-09-10 10:35pm
Vulnerable Code

cloudfuse/component/tiered_storage/tiered_storage.go

Lines 161 to 166 in d221a90

c.tmpPath = filepath.Clean(common.ExpandPath(conf.TmpPath))

if c.tmpPath == "" || c.tmpPath == "." {

return fmt.Errorf("TieredStorage: path not set in config")

}

err = os.MkdirAll(c.tmpPath, 0755)

1 Data Flow/s detected

cloudfuse/component/tiered_storage/tiered_storage.go

Line 166 in d221a90

err = os.MkdirAll(c.tmpPath, 0755)

Secure Code Warrior Training Material

Suppress Finding

To suppress this finding as a acceptable risk, comment:

/mend code suppress acceptable-risk 8f701251-0bc5-4d49-b319-2ff147f0edbf Optional Comment

To suppress this finding as a false positive, comment:

/mend code suppress false-positive 8f701251-0bc5-4d49-b319-2ff147f0edbf Optional Comment

💬 Discuss Finding

Add context or questions for the security reviewer by commenting on this issue:

/mend comment Your Message

Your message will appear in the Mend Platform for the security team to review.

mend-for-github-com · 2026-09-11T15:31:54Z

+	if !localExists {
+		return nil
+	}
+	if err := os.MkdirAll(filepath.Dir(dstPath), 0755); err != nil {


Mend Code Security Check

New finding (3 of 5)

The Mend Code Security Check of your branch failed because of a Insecure Directory Permissions finding in this line.

Severity Vulnerability Type CWE File Data Flows Detected
High Insecure Directory Permissions
CWE-732

tiered_storage.go:436
1 2026-09-10 10:35pm
Vulnerable Code

cloudfuse/component/tiered_storage/tiered_storage.go

Lines 431 to 436 in d221a90

return cloudErr

}

if !localExists {

return nil

}

if err := os.MkdirAll(filepath.Dir(dstPath), 0755); err != nil {

1 Data Flow/s detected

cloudfuse/component/tiered_storage/tiered_storage.go

Line 436 in d221a90

if err := os.MkdirAll(filepath.Dir(dstPath), 0755); err != nil {

Secure Code Warrior Training Material

Suppress Finding

To suppress this finding as a acceptable risk, comment:

/mend code suppress acceptable-risk a49883f5-68f2-49b9-a4c4-f7dfffdb65ae Optional Comment

To suppress this finding as a false positive, comment:

/mend code suppress false-positive a49883f5-68f2-49b9-a4c4-f7dfffdb65ae Optional Comment

💬 Discuss Finding

Add context or questions for the security reviewer by commenting on this issue:

/mend comment Your Message

Your message will appear in the Mend Platform for the security team to review.

mend-for-github-com · 2026-09-11T15:31:54Z

+			localCopyNode.cloudBacked.Store(true)
+
+			if options.Flags&os.O_TRUNC != 0 {
+				if err := os.MkdirAll(filepath.Dir(localPath), 0755); err != nil {


Mend Code Security Check

New finding (4 of 5)

The Mend Code Security Check of your branch failed because of a Insecure Directory Permissions finding in this line.

Severity Vulnerability Type CWE File Data Flows Detected
High Insecure Directory Permissions
CWE-732

tiered_storage.go:610
1 2026-09-10 10:35pm
Vulnerable Code

cloudfuse/component/tiered_storage/tiered_storage.go

Lines 605 to 610 in d221a90

localCopyNode := &FileNode{name: options.Name}

localCopyNode.size.Store(attrs.Size)

localCopyNode.cloudBacked.Store(true)

if options.Flags&os.O_TRUNC != 0 {

if err := os.MkdirAll(filepath.Dir(localPath), 0755); err != nil {

1 Data Flow/s detected

cloudfuse/component/tiered_storage/tiered_storage.go

Line 610 in d221a90

if err := os.MkdirAll(filepath.Dir(localPath), 0755); err != nil {

Secure Code Warrior Training Material

Suppress Finding

To suppress this finding as a acceptable risk, comment:

/mend code suppress acceptable-risk 323ec72e-fa6b-49ee-8ff5-778c5d375ac4 Optional Comment

To suppress this finding as a false positive, comment:

/mend code suppress false-positive 323ec72e-fa6b-49ee-8ff5-778c5d375ac4 Optional Comment

💬 Discuss Finding

Add context or questions for the security reviewer by commenting on this issue:

/mend comment Your Message

Your message will appear in the Mend Platform for the security team to review.

mend-for-github-com · 2026-09-11T15:31:55Z

+	if err != nil {
+		return nil, err
+	}
+	err = os.MkdirAll(filepath.Dir(localPath), 0755)


Mend Code Security Check

New finding (5 of 5)

The Mend Code Security Check of your branch failed because of a Insecure Directory Permissions finding in this line.

Severity Vulnerability Type CWE File Data Flows Detected
High Insecure Directory Permissions
CWE-732

tiered_storage.go:475
1 2026-09-10 10:35pm
Vulnerable Code

cloudfuse/component/tiered_storage/tiered_storage.go

Lines 470 to 475 in d221a90

) (*handlemap.Handle, error) {

localPath, err := c.localPath(options.Name)

if err != nil {

return nil, err

}

err = os.MkdirAll(filepath.Dir(localPath), 0755)

1 Data Flow/s detected

cloudfuse/component/tiered_storage/tiered_storage.go

Line 475 in d221a90

err = os.MkdirAll(filepath.Dir(localPath), 0755)

Secure Code Warrior Training Material

Suppress Finding

To suppress this finding as a acceptable risk, comment:

/mend code suppress acceptable-risk 4ca0f66e-6c6c-427e-a016-10e002763fc9 Optional Comment

To suppress this finding as a false positive, comment:

/mend code suppress false-positive 4ca0f66e-6c6c-427e-a016-10e002763fc9 Optional Comment

💬 Discuss Finding

Add context or questions for the security reviewer by commenting on this issue:

/mend comment Your Message

Your message will appear in the Mend Platform for the security team to review.

jfantinhardesty and others added 30 commits May 27, 2026 10:57

Add tiered storage component

318a109

Remove unused functions

0d5cbf3

Initial structure setup(First commit)

7d93b2a

Initial attempt at openFile using design

f67f1d7

Rough Design of isOverLocalLimit and openFileHelper, logic added to O…

0b27908

…penFile

More structured design flow for OpenFile and setup of test file, firs…

554a9b0

…t OpenFile test pass

Included function to make tests run, initial implementation of Create…

d77b69f

…File

OpenFile now actually opens the file instead of just returning handle…

ddd1a1b

… with no file attatched, also added some config path

Added WriteFile and dirty handle setters

3218f91

Added tests for open, write, create

de9b851

Resolved most comments from initial PR, still have to work on error c…

598371b

…ontrol

Added OpenFile with O_create case

3ed9612

Fixed O_Create and modified CreateFile (added unlocked internal funct…

55f0dfa

…ion), added tests for OpenFile O_Create

Added initial ReleaseFile and uploadFile components

ffc3909

Implemented initial design of ReleaseFile and corresponding tests

9cef74d

Implemented initial design of ReleaseFile and corresponding tests

6b919a0

2nd PR Changes

0b199fc

Initial ReadInBuffer component

d51bfe8

Added initial ReadInBuffer tests

d805f91

Initial implementation of DeleteFile, no tests yet

432d54d

Resolved additional PR1 comments

012bfc9

Merge pull request #1 from HoJacob/feature/tiered_storage_setup

2b914dd

Feature/tiered storage setup

Merge pull request #956 from HoJacob/feature/tiered_storage

2153f1e

Feature/tiered storage

Initial LRU skeleton

628feaa

Initial LRU Functions

2ccb80f

LRU eviction initial implementation

63b276c

LRU worker logic added

ca744a6

Initial LRU Code w Workers/Eviction logic

8e31b0c

LRU capacity design fix

ed56450

Fixed deadlock bugs in channels

ea8b42a

foodprocessor had a problem deploying to testing September 10, 2026 23:08 — with GitHub Actions Failure

foodprocessor had a problem deploying to testing September 10, 2026 23:09 — with GitHub Actions Error

Fix Windows error on absolute path

acb9dd6

foodprocessor had a problem deploying to testing September 10, 2026 23:14 — with GitHub Actions Error

foodprocessor had a problem deploying to testing September 10, 2026 23:14 — with GitHub Actions Failure

foodprocessor had a problem deploying to testing September 10, 2026 23:14 — with GitHub Actions Error

Fix inexact eviction test

d221a90

foodprocessor deployed to testing September 10, 2026 23:19 — with GitHub Actions Active

foodprocessor had a problem deploying to testing September 10, 2026 23:19 — with GitHub Actions Error

foodprocessor deployed to testing September 10, 2026 23:19 — with GitHub Actions Active

foodprocessor had a problem deploying to testing September 10, 2026 23:19 — with GitHub Actions Failure

foodprocessor deployed to testing September 10, 2026 23:19 — with GitHub Actions Active

foodprocessor had a problem deploying to testing September 10, 2026 23:19 — with GitHub Actions Failure

foodprocessor deployed to testing September 10, 2026 23:19 — with GitHub Actions Active

foodprocessor marked this pull request as draft September 11, 2026 06:53

mend-for-github-com Bot reviewed Sep 11, 2026

View reviewed changes

Navigation Menu

Uh oh!

Feature/tiered storage - #1049

Feature/tiered storage#1049
foodprocessor wants to merge 95 commits into
mainfrom
feature/tiered_storage

foodprocessor commented Sep 10, 2026

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

foodprocessor commented Sep 10, 2026

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Choose a reason for hiding this comment

Mend Code Security Check

New finding (1 of 5)

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Choose a reason for hiding this comment

Mend Code Security Check

New finding (2 of 5)

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Choose a reason for hiding this comment

Mend Code Security Check

New finding (3 of 5)

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Choose a reason for hiding this comment

Mend Code Security Check

New finding (4 of 5)

Uh oh!

mend-for-github-com Bot Sep 11, 2026

Choose a reason for hiding this comment

Mend Code Security Check

New finding (5 of 5)

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants